Apr 14 15:30:12 user devstack@n-api.service[61873]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 14 15:30:12 user devstack@n-api.service[61873]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 14 15:30:12 2023] *** Apr 14 15:30:12 user devstack@n-api.service[61873]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 14 15:30:12 user devstack@n-api.service[61873]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 14 15:30:12 user devstack@n-api.service[61873]: nodename: user Apr 14 15:30:12 user devstack@n-api.service[61873]: machine: x86_64 Apr 14 15:30:12 user devstack@n-api.service[61873]: clock source: unix Apr 14 15:30:12 user devstack@n-api.service[61873]: pcre jit disabled Apr 14 15:30:12 user devstack@n-api.service[61873]: detected number of CPU cores: 12 Apr 14 15:30:12 user devstack@n-api.service[61873]: current working directory: / Apr 14 15:30:12 user devstack@n-api.service[61873]: detected binary path: /usr/bin/uwsgi-core Apr 14 15:30:12 user devstack@n-api.service[61873]: your processes number limit is 63637 Apr 14 15:30:12 user devstack@n-api.service[61873]: your memory page size is 4096 bytes Apr 14 15:30:12 user devstack@n-api.service[61873]: detected max file descriptor number: 2048 Apr 14 15:30:12 user devstack@n-api.service[61873]: lock engine: pthread robust mutexes Apr 14 15:30:12 user devstack@n-api.service[61873]: thunder lock: enabled Apr 14 15:30:12 user devstack@n-api.service[61873]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 14 15:30:12 user devstack@n-api.service[61873]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 14 15:30:12 user devstack@n-api.service[61873]: Python main interpreter initialized at 0x55af3a85c990 Apr 14 15:30:12 user devstack@n-api.service[61873]: python threads support enabled Apr 14 15:30:12 user devstack@n-api.service[61873]: your server socket listen backlog is limited to 100 connections Apr 14 15:30:12 user devstack@n-api.service[61873]: your mercy for graceful operations on workers is 90 seconds Apr 14 15:30:12 user devstack@n-api.service[61873]: mapped 537436 bytes (524 KB) for 3 cores Apr 14 15:30:12 user devstack@n-api.service[61873]: *** Operational MODE: preforking *** Apr 14 15:30:12 user devstack@n-api.service[61873]: *** uWSGI is running in multiple interpreter mode *** Apr 14 15:30:12 user devstack@n-api.service[61873]: spawned uWSGI master process (pid: 61873) Apr 14 15:30:12 user devstack@n-api.service[61873]: spawned uWSGI worker 1 (pid: 61874, cores: 1) Apr 14 15:30:12 user devstack@n-api.service[61873]: spawned uWSGI worker 2 (pid: 61875, cores: 1) Apr 14 15:30:12 user devstack@n-api.service[61873]: spawned uWSGI worker 3 (pid: 61876, cores: 1) Apr 14 15:30:12 user devstack@n-api.service[61873]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 15:30:13 user devstack@n-api.service[61874]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 15:30:13 user devstack@n-api.service[61875]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 15:30:13 user devstack@n-api.service[61876]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 15:30:16 user devstack@n-api.service[61874]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 15:30:16 user devstack@n-api.service[61874]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 15:30:16 user devstack@n-api.service[61874]: and ``live_migration_inbound_addr`` respectively. Apr 14 15:30:16 user devstack@n-api.service[61874]: ). Its value may be silently ignored in the future. Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 15:30:16 user devstack@n-api.service[61875]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 15:30:16 user devstack@n-api.service[61875]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 15:30:16 user devstack@n-api.service[61875]: and ``live_migration_inbound_addr`` respectively. Apr 14 15:30:16 user devstack@n-api.service[61875]: ). Its value may be silently ignored in the future. Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 15:30:16 user devstack@n-api.service[61876]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 15:30:16 user devstack@n-api.service[61876]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 15:30:16 user devstack@n-api.service[61876]: and ``live_migration_inbound_addr`` respectively. Apr 14 15:30:16 user devstack@n-api.service[61876]: ). Its value may be silently ignored in the future. Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61875) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61876) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 15:30:16 user devstack@n-api.service[61874]: INFO dbcounter [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Registered counter for database nova_api Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG oslo_db.sqlalchemy.engines [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61874) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writer thread running {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 15:30:16 user devstack@n-api.service[61875]: INFO dbcounter [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] Registered counter for database nova_api Apr 14 15:30:16 user devstack@n-api.service[61876]: INFO dbcounter [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Registered counter for database nova_api Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG oslo_db.sqlalchemy.engines [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61875) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writer thread running {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61876) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG nova.context [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cc55bcf-99b1-4c25-9d98-1bcd635e51a5(cell1) {{(pid=61874) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writer thread running {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:30:16 user devstack@n-api.service[61874]: INFO dbcounter [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Registered counter for database nova_cell0 Apr 14 15:30:16 user devstack@n-api.service[61874]: INFO dbcounter [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Registered counter for database nova_cell1 Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG oslo_db.sqlalchemy.engines [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61874) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writer thread running {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG nova.context [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cc55bcf-99b1-4c25-9d98-1bcd635e51a5(cell1) {{(pid=61875) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG oslo_db.sqlalchemy.engines [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61874) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:30:16 user devstack@n-api.service[61875]: INFO dbcounter [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] Registered counter for database nova_cell0 Apr 14 15:30:16 user devstack@n-api.service[61875]: INFO dbcounter [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] Registered counter for database nova_cell1 Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG oslo_db.sqlalchemy.engines [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61875) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG nova.context [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cc55bcf-99b1-4c25-9d98-1bcd635e51a5(cell1) {{(pid=61876) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writer thread running {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG oslo_db.sqlalchemy.engines [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61875) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:30:16 user devstack@n-api.service[61876]: INFO dbcounter [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Registered counter for database nova_cell0 Apr 14 15:30:16 user devstack@n-api.service[61876]: INFO dbcounter [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Registered counter for database nova_cell1 Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61876) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writer thread running {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61876) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writer thread running {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 15:30:16 user devstack@n-api.service[61874]: INFO dbcounter [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Registered counter for database nova_cell0 Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG oslo_db.sqlalchemy.engines [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61874) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 15:30:16 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writer thread running {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writer thread running {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 15:30:16 user devstack@n-api.service[61875]: INFO dbcounter [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] Registered counter for database nova_cell0 Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG oslo_db.sqlalchemy.engines [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61875) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 15:30:16 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writer thread running {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writer thread running {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 15:30:16 user devstack@n-api.service[61876]: INFO dbcounter [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Registered counter for database nova_cell0 Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61876) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 15:30:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writer thread running {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 15:30:17 user devstack@n-api.service[61874]: WARNING keystonemiddleware.auth_token [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 15:30:17 user devstack@n-api.service[61874]: WARNING keystonemiddleware.auth_token [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 15:30:17 user devstack@n-api.service[61875]: WARNING keystonemiddleware.auth_token [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 15:30:17 user devstack@n-api.service[61875]: WARNING keystonemiddleware.auth_token [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 15:30:17 user devstack@n-api.service[61876]: WARNING keystonemiddleware.auth_token [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 15:30:17 user devstack@n-api.service[61876]: WARNING keystonemiddleware.auth_token [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 15:30:17 user devstack@n-api.service[61874]: WARNING keystonemiddleware.auth_token [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 15:30:17 user devstack@n-api.service[61874]: WARNING keystonemiddleware.auth_token [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 15:30:17 user devstack@n-api.service[61874]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55af3a85c990 pid: 61874 (default app) Apr 14 15:30:17 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:30:17 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.002199 Apr 14 15:30:17 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 14 15:30:17 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:30:17 user devstack@n-api.service[61875]: WARNING keystonemiddleware.auth_token [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 15:30:17 user devstack@n-api.service[61875]: WARNING keystonemiddleware.auth_token [None req-4bcaecfa-ddb4-43c6-ae7f-1156fe8cf617 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 15:30:17 user devstack@n-api.service[61875]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55af3a85c990 pid: 61875 (default app) Apr 14 15:30:17 user devstack@n-api.service[61876]: WARNING keystonemiddleware.auth_token [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 15:30:17 user devstack@n-api.service[61876]: WARNING keystonemiddleware.auth_token [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 15:30:17 user devstack@n-api.service[61876]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55af3a85c990 pid: 61876 (default app) Apr 14 15:32:25 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-4415c7b3-1abe-40be-929e-2cdc8eb46df7 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001562 Apr 14 15:32:25 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 15:32:25 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:32:26 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:32:26 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:32:26 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:32:26 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:32:26 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-74e9283a-60f4-4103-a9f1-af8fcccfcbd1 admin admin] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:26 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-74e9283a-60f4-4103-a9f1-af8fcccfcbd1 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.391287 Apr 14 15:32:26 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 15:32:25 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:32:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002083 Apr 14 15:32:28 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 15:32:28 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:32:28 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:32:28 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:32:28 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:32:28 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:32:28 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-9bab538b-11c3-4cd2-bff7-fc88e5b3e459 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "id": "c1"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:28 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-9bab538b-11c3-4cd2-bff7-fc88e5b3e459 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.362489 Apr 14 15:32:28 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 15:32:28 2023] POST /compute/v2.1/flavors => generated 405 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:32:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-461c56ab-9375-4ade-b7d7-74748c1e7248 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-461c56ab-9375-4ade-b7d7-74748c1e7248 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046588 Apr 14 15:32:28 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 15:32:28 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:32:30 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:30 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001324 Apr 14 15:32:30 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 15:32:30 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:32:30 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-6946383d-28a2-4a8e-8b7e-97e5c2c30ed5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-6946383d-28a2-4a8e-8b7e-97e5c2c30ed5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077355 Apr 14 15:32:30 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 15:32:30 2023] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:32:30 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-1ed9e7ac-8ffa-46ff-b217-2d7af33df39b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:30 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-1ed9e7ac-8ffa-46ff-b217-2d7af33df39b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026972 Apr 14 15:32:30 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 15:32:30 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:32:32 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:32 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001665 Apr 14 15:32:32 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 15:32:32 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:32:32 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-29d64385-5b20-4434-8e83-d5456d226687 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "vcpus": 1, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:32 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-29d64385-5b20-4434-8e83-d5456d226687 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.066426 Apr 14 15:32:32 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 15:32:32 2023] POST /compute/v2.1/flavors => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:32:32 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-787d6abd-25f9-460a-8c8f-fe3cfcae7b36 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-787d6abd-25f9-460a-8c8f-fe3cfcae7b36 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027660 Apr 14 15:32:32 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 15:32:32 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:32:34 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001449 Apr 14 15:32:34 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 15:32:34 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:32:34 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-ae7c06c4-d280-4786-8345-75ebe7360234 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "disk": 10}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-ae7c06c4-d280-4786-8345-75ebe7360234 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.095127 Apr 14 15:32:34 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 15:32:34 2023] POST /compute/v2.1/flavors => generated 402 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:32:34 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-9058f692-c3f1-444a-bec9-a64536b00b75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-9058f692-c3f1-444a-bec9-a64536b00b75 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078641 Apr 14 15:32:35 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 15:32:34 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:32:37 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:37 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001829 Apr 14 15:32:37 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 15:32:37 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:32:37 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-1bb8c0bf-a8d3-4226-8ae7-e8028ac1248e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "swap": 0, "disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-1bb8c0bf-a8d3-4226-8ae7-e8028ac1248e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068081 Apr 14 15:32:37 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 15:32:37 2023] POST /compute/v2.1/flavors => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:32:37 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:37 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025977 Apr 14 15:32:37 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 15:32:37 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:32:39 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:39 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6c0596ea-4dda-456b-bc45-c402bf8771af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001296 Apr 14 15:32:39 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 15:32:39 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:32:39 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-7e4cb50f-cf99-430e-96f4-1529e927f09e admin admin] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:39 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-7e4cb50f-cf99-430e-96f4-1529e927f09e admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.069370 Apr 14 15:32:39 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 15:32:39 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:32:41 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:41 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001660 Apr 14 15:32:41 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 15:32:41 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:32:41 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:32:41 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:32:41 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:32:41 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:32:41 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-2ceed932-0c8a-4d6d-9d96-eab998d03443 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512, "id": "1", "swap": 0}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-2ceed932-0c8a-4d6d-9d96-eab998d03443 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.310388 Apr 14 15:32:41 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 15:32:41 2023] POST /compute/v2.1/flavors => generated 400 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:32:41 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-0a113a7e-b048-4823-b616-b6ff72d34acc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-0a113a7e-b048-4823-b616-b6ff72d34acc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041293 Apr 14 15:32:41 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 15:32:41 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:32:43 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:43 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002182 Apr 14 15:32:43 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 15:32:43 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:32:43 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-a74ec433-f916-4ea0-a6aa-70a1f365888e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "swap": 0}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:43 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-a74ec433-f916-4ea0-a6aa-70a1f365888e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068800 Apr 14 15:32:43 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 15:32:43 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:32:43 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-0155b5d6-329a-4d66-bd9b-6365f2f09a8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:43 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-0155b5d6-329a-4d66-bd9b-6365f2f09a8c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044369 Apr 14 15:32:43 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 15:32:43 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:32:45 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:45 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001540 Apr 14 15:32:45 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 15:32:45 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:32:45 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-61183425-fcca-4e4d-a1eb-4e1786cb9cec admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:45 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-61183425-fcca-4e4d-a1eb-4e1786cb9cec admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.065525 Apr 14 15:32:45 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 15:32:45 2023] POST /compute/v2.1/flavors => generated 404 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:32:45 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-bce30294-c453-4a45-8f36-75fae950cb1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:45 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-bce30294-c453-4a45-8f36-75fae950cb1d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026480 Apr 14 15:32:45 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 15:32:45 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:32:47 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:47 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001357 Apr 14 15:32:47 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 15:32:47 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:32:47 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-23542cdc-c8dc-4640-9fdd-2ec62a304bf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "ram": 8192, "vcpus": 4}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:47 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-23542cdc-c8dc-4640-9fdd-2ec62a304bf2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064078 Apr 14 15:32:47 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 15:32:47 2023] POST /compute/v2.1/flavors => generated 403 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:32:47 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-0313f4d1-fd5f-4fe8-9828-87adc6756db9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:48 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-0313f4d1-fd5f-4fe8-9828-87adc6756db9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023356 Apr 14 15:32:48 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 15:32:47 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:32:49 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:32:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001356 Apr 14 15:32:49 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 15:32:49 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:32:50 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6380312b-9ddd-4645-b275-c6197668a6a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "name": "m1.xlarge"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:50 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6380312b-9ddd-4645-b275-c6197668a6a2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.060384 Apr 14 15:32:50 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 15:32:49 2023] POST /compute/v2.1/flavors => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:32:50 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-46c614b5-f568-481c-b4b5-f01a6e893a89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:32:50 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-46c614b5-f568-481c-b4b5-f01a6e893a89 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024167 Apr 14 15:32:50 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 15:32:50 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:33:20 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:33:20 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-bafef21f-4bfa-4cea-b3f7-56fc3be43632 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001583 Apr 14 15:33:20 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 15:33:20 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:33:20 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:33:20 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-b4dffa55-4fcd-460d-9b1f-f5707eae7253 admin admin] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:33:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b4dffa55-4fcd-460d-9b1f-f5707eae7253 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:33:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b4dffa55-4fcd-460d-9b1f-f5707eae7253 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:33:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b4dffa55-4fcd-460d-9b1f-f5707eae7253 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:33:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b4dffa55-4fcd-460d-9b1f-f5707eae7253 admin admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:33:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b4dffa55-4fcd-460d-9b1f-f5707eae7253 admin admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:33:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b4dffa55-4fcd-460d-9b1f-f5707eae7253 admin admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:33:20 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-b4dffa55-4fcd-460d-9b1f-f5707eae7253 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.140839 Apr 14 15:33:20 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 14 15:33:20 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:33:53 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-46c614b5-f568-481c-b4b5-f01a6e893a89 admin admin] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:33:53 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-46c614b5-f568-481c-b4b5-f01a6e893a89 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002040 Apr 14 15:33:53 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 15:33:53 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:33:53 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:33:53 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-aee7323a-d0a6-467f-a35b-bf14df7444bb admin admin] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:33:53 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-aee7323a-d0a6-467f-a35b-bf14df7444bb admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.064845 Apr 14 15:33:53 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 14 15:33:53 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:33:57 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-b4dffa55-4fcd-460d-9b1f-f5707eae7253 admin admin] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:33:57 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-b4dffa55-4fcd-460d-9b1f-f5707eae7253 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001730 Apr 14 15:33:57 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 15:33:57 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:33:57 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:33:57 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-bd131ab5-6b36-401a-b40b-f50f3dd15391 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.nano", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 128, "id": "42", "disk": 1}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:33:57 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-bd131ab5-6b36-401a-b40b-f50f3dd15391 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.066152 Apr 14 15:33:57 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 15:33:57 2023] POST /compute/v2.1/flavors => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:33:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-dca75f3c-0921-4970-a8cf-678c6e4c479e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:33:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-dca75f3c-0921-4970-a8cf-678c6e4c479e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027535 Apr 14 15:33:57 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 15:33:57 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 15:34:01 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-b4dffa55-4fcd-460d-9b1f-f5707eae7253 admin admin] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:34:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-b4dffa55-4fcd-460d-9b1f-f5707eae7253 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001496 Apr 14 15:34:01 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 15:34:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:34:01 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2aebfeb4-c982-4cd1-9bfc-c4a27b8f3cf0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.micro", "swap": 0, "id": "84", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:34:01 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-2aebfeb4-c982-4cd1-9bfc-c4a27b8f3cf0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.065332 Apr 14 15:34:01 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 15:34:01 2023] POST /compute/v2.1/flavors => generated 404 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:34:01 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a282ba51-acc3-4d91-b98a-d3b700aaafb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:34:01 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a282ba51-acc3-4d91-b98a-d3b700aaafb0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023828 Apr 14 15:34:01 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 15:34:01 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:36:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:36:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:36:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:36:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-725322254", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "ea6d4df1-4011-4c69-88e2-db5315873558"}]}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:28 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] validate_networks() for [('ea6d4df1-4011-4c69-88e2-db5315873558', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:36:29 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:36:30 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1469009849", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40"}]}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:30 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] validate_networks() for [('dd14d44b-4a04-4aa4-9dfd-1933f29c3a40', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Getting quotas for project ef8097227d514468b100a6a637bb6287. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Getting quotas for user 556b4bd256ee41398d5fd89ef2191550 and project ef8097227d514468b100a6a637bb6287. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:36:31 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:36:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.282925 Apr 14 15:36:31 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:36:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 3284 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:36:31 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-60726339-6baf-4176-b652-5ce00ff50e74 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:36:31 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-60726339-6baf-4176-b652-5ce00ff50e74 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:36:31 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:36:31 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-60726339-6baf-4176-b652-5ce00ff50e74 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b4bd256ee41398d5fd89ef2191550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8097227d514468b100a6a637bb6287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:36:31 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-60726339-6baf-4176-b652-5ce00ff50e74 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6" status: 200 len: 1208 microversion: 2.1 time: 0.563792 Apr 14 15:36:31 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 16/47] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:36:31 2023] GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6 => generated 1208 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:36:32 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1391704245", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "7c17386f-ee51-4b70-936e-ca90f2fb5615"}]}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:32 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] validate_networks() for [('7c17386f-ee51-4b70-936e-ca90f2fb5615', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Getting quotas for project 3a8e73ef2ad94e84876def53ddf43da4. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Getting quotas for user af824b840c604223afd90bce17fe1ceb and project 3a8e73ef2ad94e84876def53ddf43da4. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:36:33 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.605515 Apr 14 15:36:33 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 17/48] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:36:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 3608 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:36:33 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-7d3446f0-a75f-463d-af43-124961ffc8c0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:36:33 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-7d3446f0-a75f-463d-af43-124961ffc8c0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:36:33 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-7d3446f0-a75f-463d-af43-124961ffc8c0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af824b840c604223afd90bce17fe1ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e73ef2ad94e84876def53ddf43da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:36:33 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-7d3446f0-a75f-463d-af43-124961ffc8c0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a" status: 200 len: 1211 microversion: 2.1 time: 0.228514 Apr 14 15:36:33 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 17/49] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:36:33 2023] GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a => generated 1211 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-0b38afc0-810c-463a-9db4-7f3cf2e90148 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Action: 'create', calling method: .version_select at 0x7f2971894670>, body: {"keypair": {"name": "tempest-keypair-985297908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvPHEwKozg7h6r4JnJpSzBWhs511e+AcMrK/R2mBj8TGR21rZjvip0yg4hAZLhZammhHG2RLycjW8OY5YH3WpdSWl4G97OD9UkFa1PzKidrzi0TtxEVyGAc8SnkIc1I4Q=="}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-0b38afc0-810c-463a-9db4-7f3cf2e90148 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Getting quotas for project a8230c5386464f288fd783b3c60536b4. Resources: {'key_pairs'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:36:33 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-0b38afc0-810c-463a-9db4-7f3cf2e90148 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Getting quotas for user f805db20d87d4429981c975ebd88ed92 and project a8230c5386464f288fd783b3c60536b4. Resources: {'key_pairs'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:36:33 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-0b38afc0-810c-463a-9db4-7f3cf2e90148 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.178103 Apr 14 15:36:33 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 18/50] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 15:36:33 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting quotas for project 584a53650c014f87b9622f2011996200. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting quotas for user efb645d110464e7e85d7c955ee9f3466 and project 584a53650c014f87b9622f2011996200. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:36:35 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:36:35 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 3.378941 Apr 14 15:36:35 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 16/51] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 15:36:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 3382 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 15:36:35 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-fd27436e-d104-4e07-95a5-79ad6dda44e7 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:36:35 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-fd27436e-d104-4e07-95a5-79ad6dda44e7 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:36:35 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-fd27436e-d104-4e07-95a5-79ad6dda44e7 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:36:35 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-fd27436e-d104-4e07-95a5-79ad6dda44e7 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:36:35 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-fd27436e-d104-4e07-95a5-79ad6dda44e7 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:36:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-fd27436e-d104-4e07-95a5-79ad6dda44e7 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c" status: 200 len: 1395 microversion: 2.87 time: 0.237779 Apr 14 15:36:35 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 18/52] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:36:35 2023] GET /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c => generated 1395 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:36:41 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c66b5102-c56e-4209-afb2-c2594b271af6", "tag": "4b57e07f-f5a9-4524-9f4a-f97133808b99"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] Creating event network-changed:4b57e07f-f5a9-4524-9f4a-f97133808b99 for instance c66b5102-c56e-4209-afb2-c2594b271af6 on user Apr 14 15:36:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 15:36:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 15:36:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5b09459c-7978-412a-8a47-579a9ee8165b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5b09459c-7978-412a-8a47-579a9ee8165b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5b09459c-7978-412a-8a47-579a9ee8165b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5b09459c-7978-412a-8a47-579a9ee8165b None None] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5b09459c-7978-412a-8a47-579a9ee8165b None None] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5b09459c-7978-412a-8a47-579a9ee8165b None None] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:41 user devstack@n-api.service[61874]: INFO nova.compute.rpcapi [None req-5b09459c-7978-412a-8a47-579a9ee8165b None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 15:36:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5b09459c-7978-412a-8a47-579a9ee8165b None None] Releasing lock "compute-rpcapi-router" {{(pid=61874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 15:36:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-5b09459c-7978-412a-8a47-579a9ee8165b None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229897 Apr 14 15:36:41 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 19/53] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:36:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:36:42 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-660406846", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "3f472477-20b4-41e0-86c9-32659cc16f4f"}], "security_groups": [{"name": "tempest-securitygroup--1493847437"}], "key_name": "tempest-keypair-985297908", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:42 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-797939149", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:42 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] validate_networks() for [('1db86179-bd15-40ef-af2b-5d1b5c8fb4bd', None, None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:36:42 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] validate_networks() for [('3f472477-20b4-41e0-86c9-32659cc16f4f', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:36:43 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0339b7d6-294b-4669-9782-51de5748226a", "tag": "29225f48-b889-4b7d-b5be-6c47f5c4b076"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:43 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] Creating event network-changed:29225f48-b889-4b7d-b5be-6c47f5c4b076 for instance 0339b7d6-294b-4669-9782-51de5748226a on user Apr 14 15:36:43 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107369 Apr 14 15:36:43 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 20/54] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:36:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:36:44 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=10 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:36:44 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e21d6b-fc8f-4373-a54f-452ab5fa169c", "tag": "e04c622c-58ef-477e-8d37-eb052355492e"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:44 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] Creating event network-changed:e04c622c-58ef-477e-8d37-eb052355492e for instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c on user Apr 14 15:36:44 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030679 Apr 14 15:36:44 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 21/55] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:36:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Getting quotas for project a8230c5386464f288fd783b3c60536b4. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Getting quotas for user f805db20d87d4429981c975ebd88ed92 and project a8230c5386464f288fd783b3c60536b4. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:44 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.103677 Apr 14 15:36:44 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 17/56] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:36:42 2023] POST /compute/v2.1/servers => generated 404 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:36:44 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-80b8ffc2-cc28-4713-9d56-8f2b396148a7 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:36:44 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-80b8ffc2-cc28-4713-9d56-8f2b396148a7 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting quotas for project 609ac7b149e14baab270d83a2646fbdf. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting quotas for user 3fa924fefda1428d81152fd573540f26 and project 609ac7b149e14baab270d83a2646fbdf. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:36:44 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.255477 Apr 14 15:36:44 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 19/57] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:36:42 2023] POST /compute/v2.1/servers => generated 381 bytes in 2257 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-f1f452b8-15cc-4437-85cf-fae8b30e4c68 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-f1f452b8-15cc-4437-85cf-fae8b30e4c68 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:36:44 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-80b8ffc2-cc28-4713-9d56-8f2b396148a7 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f805db20d87d4429981c975ebd88ed92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8230c5386464f288fd783b3c60536b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:36:44 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-80b8ffc2-cc28-4713-9d56-8f2b396148a7 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed" status: 200 len: 1238 microversion: 2.1 time: 0.242711 Apr 14 15:36:44 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 22/58] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:36:44 2023] GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed => generated 1238 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:36:44 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-f1f452b8-15cc-4437-85cf-fae8b30e4c68 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:36:44 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-f1f452b8-15cc-4437-85cf-fae8b30e4c68 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4" status: 200 len: 1215 microversion: 2.1 time: 0.137757 Apr 14 15:36:44 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 18/59] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:36:44 2023] GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4 => generated 1215 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:36:44 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1486944866", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:45 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] validate_networks() for [('1db86179-bd15-40ef-af2b-5d1b5c8fb4bd', None, None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting quotas for project 609ac7b149e14baab270d83a2646fbdf. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting quotas for user 3fa924fefda1428d81152fd573540f26 and project 609ac7b149e14baab270d83a2646fbdf. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:36:46 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:36:46 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.577070 Apr 14 15:36:46 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 20/60] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:36:44 2023] POST /compute/v2.1/servers => generated 381 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:36:46 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4240f9c9-e53b-4507-ad2c-9af06f952461 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:36:46 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-4240f9c9-e53b-4507-ad2c-9af06f952461 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:36:46 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-4240f9c9-e53b-4507-ad2c-9af06f952461 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:36:46 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-4240f9c9-e53b-4507-ad2c-9af06f952461 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c" status: 200 len: 1216 microversion: 2.1 time: 0.144612 Apr 14 15:36:46 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 23/61] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:36:46 2023] GET /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c => generated 1216 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:36:49 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-29c67889-9319-4cf3-b229-89b6ebbf4f27 req-7834e3d1-dc81-448a-8003-d79aa8fc7c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0339b7d6-294b-4669-9782-51de5748226a", "name": "network-vif-plugged", "status": "completed", "tag": "29225f48-b889-4b7d-b5be-6c47f5c4b076"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-29c67889-9319-4cf3-b229-89b6ebbf4f27 req-7834e3d1-dc81-448a-8003-d79aa8fc7c1e service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-29c67889-9319-4cf3-b229-89b6ebbf4f27 req-7834e3d1-dc81-448a-8003-d79aa8fc7c1e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-29c67889-9319-4cf3-b229-89b6ebbf4f27 req-7834e3d1-dc81-448a-8003-d79aa8fc7c1e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:49 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-29c67889-9319-4cf3-b229-89b6ebbf4f27 req-7834e3d1-dc81-448a-8003-d79aa8fc7c1e service nova] Creating event network-vif-plugged:29225f48-b889-4b7d-b5be-6c47f5c4b076 for instance 0339b7d6-294b-4669-9782-51de5748226a on user Apr 14 15:36:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-29c67889-9319-4cf3-b229-89b6ebbf4f27 req-7834e3d1-dc81-448a-8003-d79aa8fc7c1e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61876) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 15:36:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-29c67889-9319-4cf3-b229-89b6ebbf4f27 req-7834e3d1-dc81-448a-8003-d79aa8fc7c1e service nova] Acquired lock "compute-rpcapi-router" {{(pid=61876) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 15:36:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-94d7daea-2e86-4b70-a07e-99654cc7719f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-94d7daea-2e86-4b70-a07e-99654cc7719f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-94d7daea-2e86-4b70-a07e-99654cc7719f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-94d7daea-2e86-4b70-a07e-99654cc7719f None None] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-94d7daea-2e86-4b70-a07e-99654cc7719f None None] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-94d7daea-2e86-4b70-a07e-99654cc7719f None None] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:49 user devstack@n-api.service[61876]: INFO nova.compute.rpcapi [None req-94d7daea-2e86-4b70-a07e-99654cc7719f None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 15:36:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-94d7daea-2e86-4b70-a07e-99654cc7719f None None] Releasing lock "compute-rpcapi-router" {{(pid=61876) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 15:36:49 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-94d7daea-2e86-4b70-a07e-99654cc7719f None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098871 Apr 14 15:36:49 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 19/62] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:36:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:36:49 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-1b451a2c-a361-44b9-aa97-e936f11c284d req-3bb916dd-4541-4311-9f1b-06ce51997b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e21d6b-fc8f-4373-a54f-452ab5fa169c", "name": "network-vif-plugged", "status": "completed", "tag": "e04c622c-58ef-477e-8d37-eb052355492e"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1b451a2c-a361-44b9-aa97-e936f11c284d req-3bb916dd-4541-4311-9f1b-06ce51997b6f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1b451a2c-a361-44b9-aa97-e936f11c284d req-3bb916dd-4541-4311-9f1b-06ce51997b6f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1b451a2c-a361-44b9-aa97-e936f11c284d req-3bb916dd-4541-4311-9f1b-06ce51997b6f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-1b451a2c-a361-44b9-aa97-e936f11c284d req-3bb916dd-4541-4311-9f1b-06ce51997b6f service nova] Creating event network-vif-plugged:e04c622c-58ef-477e-8d37-eb052355492e for instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c on user Apr 14 15:36:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1b451a2c-a361-44b9-aa97-e936f11c284d req-3bb916dd-4541-4311-9f1b-06ce51997b6f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61875) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 15:36:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1b451a2c-a361-44b9-aa97-e936f11c284d req-3bb916dd-4541-4311-9f1b-06ce51997b6f service nova] Acquired lock "compute-rpcapi-router" {{(pid=61875) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 15:36:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dafa1053-1762-4846-ae42-921798eee70a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dafa1053-1762-4846-ae42-921798eee70a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dafa1053-1762-4846-ae42-921798eee70a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dafa1053-1762-4846-ae42-921798eee70a None None] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dafa1053-1762-4846-ae42-921798eee70a None None] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dafa1053-1762-4846-ae42-921798eee70a None None] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:49 user devstack@n-api.service[61875]: INFO nova.compute.rpcapi [None req-dafa1053-1762-4846-ae42-921798eee70a None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 15:36:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dafa1053-1762-4846-ae42-921798eee70a None None] Releasing lock "compute-rpcapi-router" {{(pid=61875) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 15:36:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-dafa1053-1762-4846-ae42-921798eee70a None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199151 Apr 14 15:36:49 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:36:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:36:51 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0339b7d6-294b-4669-9782-51de5748226a", "name": "network-vif-plugged", "status": "completed", "tag": "29225f48-b889-4b7d-b5be-6c47f5c4b076"}, {"server_uuid": "c66b5102-c56e-4209-afb2-c2594b271af6", "name": "network-vif-plugged", "status": "completed", "tag": "4b57e07f-f5a9-4524-9f4a-f97133808b99"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:51 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] Creating event network-vif-plugged:29225f48-b889-4b7d-b5be-6c47f5c4b076 for instance 0339b7d6-294b-4669-9782-51de5748226a on user Apr 14 15:36:51 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] Creating event network-vif-plugged:4b57e07f-f5a9-4524-9f4a-f97133808b99 for instance c66b5102-c56e-4209-afb2-c2594b271af6 on user Apr 14 15:36:51 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:36:51 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055335 Apr 14 15:36:51 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 24/64] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:36:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:36:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e21d6b-fc8f-4373-a54f-452ab5fa169c", "name": "network-vif-plugged", "status": "completed", "tag": "e04c622c-58ef-477e-8d37-eb052355492e"}, {"name": "network-changed", "server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] Creating event network-vif-plugged:e04c622c-58ef-477e-8d37-eb052355492e for instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c on user Apr 14 15:36:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] Creating event network-changed:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:36:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047611 Apr 14 15:36:52 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 20/65] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:36:51 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:36:52 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40b5c2de-9cb2-4bcc-a04a-a4924e51151c", "tag": "7d184083-9af2-4aad-abc5-7d9c28804ee1"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] Creating event network-changed:7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c on user Apr 14 15:36:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057767 Apr 14 15:36:52 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 22/66] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:36:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:36:53 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-08ab5921-841f-4d32-b307-d9fee3feb20d req-b6fddcea-111d-4f6d-b0d9-3b34d7f0a3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66b5102-c56e-4209-afb2-c2594b271af6", "name": "network-vif-plugged", "status": "completed", "tag": "4b57e07f-f5a9-4524-9f4a-f97133808b99"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-08ab5921-841f-4d32-b307-d9fee3feb20d req-b6fddcea-111d-4f6d-b0d9-3b34d7f0a3d1 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-08ab5921-841f-4d32-b307-d9fee3feb20d req-b6fddcea-111d-4f6d-b0d9-3b34d7f0a3d1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-08ab5921-841f-4d32-b307-d9fee3feb20d req-b6fddcea-111d-4f6d-b0d9-3b34d7f0a3d1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:53 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-08ab5921-841f-4d32-b307-d9fee3feb20d req-b6fddcea-111d-4f6d-b0d9-3b34d7f0a3d1 service nova] Creating event network-vif-plugged:4b57e07f-f5a9-4524-9f4a-f97133808b99 for instance c66b5102-c56e-4209-afb2-c2594b271af6 on user Apr 14 15:36:53 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-08ab5921-841f-4d32-b307-d9fee3feb20d req-b6fddcea-111d-4f6d-b0d9-3b34d7f0a3d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044136 Apr 14 15:36:53 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 25/67] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:36:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:36:55 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=20 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:36:55 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}, {"server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "name": "network-vif-plugged", "status": "completed", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:56 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] Creating event network-changed:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:36:56 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] Creating event network-vif-plugged:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:36:56 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.116225 Apr 14 15:36:56 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 21/68] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:36:55 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:36:56 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-f76aa5eb-4592-45c1-97f9-b48c9ce4b6a2 req-359dddec-747d-45a2-82af-ed22a9baea59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b5c2de-9cb2-4bcc-a04a-a4924e51151c", "name": "network-vif-plugged", "status": "completed", "tag": "7d184083-9af2-4aad-abc5-7d9c28804ee1"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:56 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=18 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:36:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-f76aa5eb-4592-45c1-97f9-b48c9ce4b6a2 req-359dddec-747d-45a2-82af-ed22a9baea59 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-f76aa5eb-4592-45c1-97f9-b48c9ce4b6a2 req-359dddec-747d-45a2-82af-ed22a9baea59 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-f76aa5eb-4592-45c1-97f9-b48c9ce4b6a2 req-359dddec-747d-45a2-82af-ed22a9baea59 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-f76aa5eb-4592-45c1-97f9-b48c9ce4b6a2 req-359dddec-747d-45a2-82af-ed22a9baea59 service nova] Creating event network-vif-plugged:7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c on user Apr 14 15:36:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-f76aa5eb-4592-45c1-97f9-b48c9ce4b6a2 req-359dddec-747d-45a2-82af-ed22a9baea59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071790 Apr 14 15:36:56 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 23/69] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:36:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:36:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:36:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-1f47f4d4-02ea-44fb-9b4c-bb61411e69bf req-5d1b3be0-cc28-4e5f-83c7-4959cd63a675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "name": "network-vif-plugged", "status": "completed", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1f47f4d4-02ea-44fb-9b4c-bb61411e69bf req-5d1b3be0-cc28-4e5f-83c7-4959cd63a675 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1f47f4d4-02ea-44fb-9b4c-bb61411e69bf req-5d1b3be0-cc28-4e5f-83c7-4959cd63a675 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1f47f4d4-02ea-44fb-9b4c-bb61411e69bf req-5d1b3be0-cc28-4e5f-83c7-4959cd63a675 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-1f47f4d4-02ea-44fb-9b4c-bb61411e69bf req-5d1b3be0-cc28-4e5f-83c7-4959cd63a675 service nova] Creating event network-vif-plugged:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:36:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-1f47f4d4-02ea-44fb-9b4c-bb61411e69bf req-5d1b3be0-cc28-4e5f-83c7-4959cd63a675 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103328 Apr 14 15:36:58 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 26/70] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:36:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:36:58 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-3ad7acee-3007-4aca-b4fa-283b678816d9 req-3a7e0a99-fa2c-4186-a193-b487844265f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b5c2de-9cb2-4bcc-a04a-a4924e51151c", "name": "network-vif-plugged", "status": "completed", "tag": "7d184083-9af2-4aad-abc5-7d9c28804ee1"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:36:59 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=9 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:36:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-3ad7acee-3007-4aca-b4fa-283b678816d9 req-3a7e0a99-fa2c-4186-a193-b487844265f9 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:36:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-3ad7acee-3007-4aca-b4fa-283b678816d9 req-3a7e0a99-fa2c-4186-a193-b487844265f9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:36:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-3ad7acee-3007-4aca-b4fa-283b678816d9 req-3a7e0a99-fa2c-4186-a193-b487844265f9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:36:59 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=15 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:36:59 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-3ad7acee-3007-4aca-b4fa-283b678816d9 req-3a7e0a99-fa2c-4186-a193-b487844265f9 service nova] Creating event network-vif-plugged:7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c on user Apr 14 15:36:59 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-3ad7acee-3007-4aca-b4fa-283b678816d9 req-3a7e0a99-fa2c-4186-a193-b487844265f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106118 Apr 14 15:36:59 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 22/71] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:36:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:00 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:00 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-edefd9c6-059f-40e5-ba95-88938b9720f3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Action: 'create', calling method: .version_select at 0x7f2970f0acb0>, body: {"keypair": {"name": "tempest-keypair-1028605759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdVb9qsJSLS3Bgfyq6KylCGL6p6wxpntlLqZCZt1R/qL08QarxPv7eu4MozJC3l12xLn6LGwBQgTP4zKdsaYGDeB2GiKSBHU5x054fe5UNG2NcO4opY99adqDnprJnJRQ=="}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:00 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-edefd9c6-059f-40e5-ba95-88938b9720f3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Getting quotas for project 029b8c395f264a86933a9e878c18e0b2. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:37:00 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-edefd9c6-059f-40e5-ba95-88938b9720f3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Getting quotas for user e1aa921f86bd4f3b88eb782d5f667816 and project 029b8c395f264a86933a9e878c18e0b2. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:37:00 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-edefd9c6-059f-40e5-ba95-88938b9720f3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.479849 Apr 14 15:37:00 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 24/72] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 15:37:00 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:00 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-6a246fd4-d1bd-4c1c-b314-536e9d438eb7 req-c6bbcbe0-ee06-41cc-b617-aee020afc53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-plugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:00 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:00 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6a246fd4-d1bd-4c1c-b314-536e9d438eb7 req-c6bbcbe0-ee06-41cc-b617-aee020afc53b service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:00 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6a246fd4-d1bd-4c1c-b314-536e9d438eb7 req-c6bbcbe0-ee06-41cc-b617-aee020afc53b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:00 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6a246fd4-d1bd-4c1c-b314-536e9d438eb7 req-c6bbcbe0-ee06-41cc-b617-aee020afc53b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:00 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=17 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:00 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-6a246fd4-d1bd-4c1c-b314-536e9d438eb7 req-c6bbcbe0-ee06-41cc-b617-aee020afc53b service nova] Creating event network-vif-plugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:37:00 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-6a246fd4-d1bd-4c1c-b314-536e9d438eb7 req-c6bbcbe0-ee06-41cc-b617-aee020afc53b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056727 Apr 14 15:37:00 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 27/73] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:02 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:02 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-e13434ed-b35b-4db2-a607-91d84f70b443 req-2d4b1346-803a-4912-86e8-643cffa800c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-plugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-e13434ed-b35b-4db2-a607-91d84f70b443 req-2d4b1346-803a-4912-86e8-643cffa800c2 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-e13434ed-b35b-4db2-a607-91d84f70b443 req-2d4b1346-803a-4912-86e8-643cffa800c2 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-e13434ed-b35b-4db2-a607-91d84f70b443 req-2d4b1346-803a-4912-86e8-643cffa800c2 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:02 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-e13434ed-b35b-4db2-a607-91d84f70b443 req-2d4b1346-803a-4912-86e8-643cffa800c2 service nova] Creating event network-vif-plugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:37:02 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-e13434ed-b35b-4db2-a607-91d84f70b443 req-2d4b1346-803a-4912-86e8-643cffa800c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052431 Apr 14 15:37:02 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 23/74] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:09 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=12 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-487888847", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "f640a309-f997-4ae7-8c15-cd2a0e846ca4"}], "security_groups": [{"name": "tempest-securitygroup--1707386638"}], "key_name": "tempest-keypair-1028605759", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:09 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:09 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] validate_networks() for [('f640a309-f997-4ae7-8c15-cd2a0e846ca4', None, None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:37:10 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Getting quotas for project 029b8c395f264a86933a9e878c18e0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Getting quotas for user e1aa921f86bd4f3b88eb782d5f667816 and project 029b8c395f264a86933a9e878c18e0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:37:11 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:37:11 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.178799 Apr 14 15:37:11 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 25/75] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:37:09 2023] POST /compute/v2.1/servers => generated 404 bytes in 2182 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:37:11 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:11 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:11 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-60423189-653d-46c8-a832-7805d1713bca tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:37:11 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-60423189-653d-46c8-a832-7805d1713bca tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:37:11 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-60423189-653d-46c8-a832-7805d1713bca tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1aa921f86bd4f3b88eb782d5f667816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '029b8c395f264a86933a9e878c18e0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:11 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-60423189-653d-46c8-a832-7805d1713bca tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0" status: 200 len: 1235 microversion: 2.1 time: 0.096275 Apr 14 15:37:11 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 28/76] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:37:11 2023] GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0 => generated 1235 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:37:12 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:12 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:12 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-67b6c191-f4c4-49a3-8944-e45edde40825 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Action: 'create', calling method: .version_select at 0x7f29718e7d90>, body: {"keypair": {"name": "tempest-keypair-1390268231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoPs0hr2S89qa5HJoTWExnkbcMJl7mVEmKXO1Z43KzeIRd82SH9/UKYZVvEh37jqfaLeW9ytkKTE2z/yCTgCYiPlndaiDPUtYOZHOLYZHmj1s0YcA3j9fEBYOveLu7ycw=="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:12 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-67b6c191-f4c4-49a3-8944-e45edde40825 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Getting quotas for project f84eb038f3914d54a892a6dabdf6f67b. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:37:12 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-67b6c191-f4c4-49a3-8944-e45edde40825 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Getting quotas for user 8903273cb7ea4a0c9831dbcc74361ae2 and project f84eb038f3914d54a892a6dabdf6f67b. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:37:12 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-67b6c191-f4c4-49a3-8944-e45edde40825 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127931 Apr 14 15:37:12 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 24/77] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 15:37:12 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:13 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f162218b-db9f-43ce-b011-1d0e65004dbb tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Action: 'create', calling method: .version_select at 0x7f2970f0a950>, body: {"keypair": {"name": "tempest-keypair-1207070274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAACMkTQdvaP771MHaqaa+acYdO2/wpe+WaVnIVpCxc1+9acrx0ws40PfVns7FOqGg8PvqZQBCNW1hApCelVmig7oDDClZY+ILL8blZrPBAn3T/D/58PPa2D4eUWFdfROw=="}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:13 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-f162218b-db9f-43ce-b011-1d0e65004dbb tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Getting quotas for project 02da33469a7a477b876331e9b846b99a. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:37:13 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-f162218b-db9f-43ce-b011-1d0e65004dbb tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Getting quotas for user e4611274a77c4f3a8333771568ce9fbc and project 02da33469a7a477b876331e9b846b99a. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:37:13 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-f162218b-db9f-43ce-b011-1d0e65004dbb tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.287523 Apr 14 15:37:13 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 26/78] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 15:37:13 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:15 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f094302b-0730-4754-b9e9-ec203312b8c0", "tag": "674fa5df-38fc-4d44-9f38-fbae08c80e81"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:15 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:15 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:15 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:15 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] Creating event network-changed:674fa5df-38fc-4d44-9f38-fbae08c80e81 for instance f094302b-0730-4754-b9e9-ec203312b8c0 on user Apr 14 15:37:15 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047263 Apr 14 15:37:15 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 29/79] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-581725796", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "94222530-78ac-488b-a318-50b1ae27bc59"}], "security_groups": [{"name": "tempest-securitygroup--1869608368"}], "key_name": "tempest-keypair-1390268231", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:16 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] validate_networks() for [('94222530-78ac-488b-a318-50b1ae27bc59', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:37:17 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f8155bc2-a776-4432-96d3-9e12a581c363 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Action: 'create', calling method: .version_select at 0x7f2970f0a9e0>, body: {"keypair": {"name": "tempest-keypair-1198337819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5RqNKyf3EcPCxOaPrOsJ1s4hAWPmt82z8J8sQ7woV0DMNzn8JiQxsFypnbqGGF9uoHXaZHLMdUkLgjPxwO+kYWK7nGbxMSuBBVNULFkVDK4VATwZsj3BsXkzww+sDdcg=="}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:17 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-f8155bc2-a776-4432-96d3-9e12a581c363 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Getting quotas for project ead92c17f9e64b90adac77a44a473bde. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:37:17 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-f8155bc2-a776-4432-96d3-9e12a581c363 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Getting quotas for user 9a5a6a16abaa4c63b0220beb95fc9613 and project ead92c17f9e64b90adac77a44a473bde. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:37:17 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1881974023", "imageRef": "bcf08c49-d94f-43c3-882d-e1176741d8e1", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "3816a79e-94dd-4b7a-b92b-53395c339a4f"}], "security_groups": [{"name": "tempest-securitygroup--881983514"}], "key_name": "tempest-keypair-1207070274", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:17 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-f8155bc2-a776-4432-96d3-9e12a581c363 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.068274 Apr 14 15:37:17 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 27/80] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 15:37:17 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 15:37:17 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] validate_networks() for [('3816a79e-94dd-4b7a-b92b-53395c339a4f', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Getting quotas for project f84eb038f3914d54a892a6dabdf6f67b. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Getting quotas for user 8903273cb7ea4a0c9831dbcc74361ae2 and project f84eb038f3914d54a892a6dabdf6f67b. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:37:17 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:37:17 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.493722 Apr 14 15:37:17 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 25/81] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:37:16 2023] POST /compute/v2.1/servers => generated 404 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:37:17 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-9ca8a05e-a5c5-4515-ba6d-4992463c2923 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:37:17 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-9ca8a05e-a5c5-4515-ba6d-4992463c2923 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:37:17 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-9ca8a05e-a5c5-4515-ba6d-4992463c2923 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8903273cb7ea4a0c9831dbcc74361ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eb038f3914d54a892a6dabdf6f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:17 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-9ca8a05e-a5c5-4515-ba6d-4992463c2923 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a" status: 200 len: 1225 microversion: 2.1 time: 0.072875 Apr 14 15:37:17 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 28/82] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:37:17 2023] GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a => generated 1225 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Getting quotas for project 02da33469a7a477b876331e9b846b99a. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Getting quotas for user e4611274a77c4f3a8333771568ce9fbc and project 02da33469a7a477b876331e9b846b99a. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:37:18 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcf08c49-d94f-43c3-882d-e1176741d8e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:37:18 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.362599 Apr 14 15:37:18 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 30/83] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:37:17 2023] POST /compute/v2.1/servers => generated 403 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:37:18 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-343e08b1-f2b5-4a3c-97a0-863252673828 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:37:18 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-343e08b1-f2b5-4a3c-97a0-863252673828 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:37:18 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-343e08b1-f2b5-4a3c-97a0-863252673828 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4611274a77c4f3a8333771568ce9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02da33469a7a477b876331e9b846b99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:18 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-343e08b1-f2b5-4a3c-97a0-863252673828 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" status: 200 len: 1240 microversion: 2.1 time: 0.142847 Apr 14 15:37:18 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 26/84] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:37:18 2023] GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 => generated 1240 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:37:18 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-a6dd2796-9e9a-4ca2-9ba8-7c9029fb377d req-98f78beb-281f-494c-a0a7-9f71101cfcfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f094302b-0730-4754-b9e9-ec203312b8c0", "name": "network-vif-plugged", "status": "completed", "tag": "674fa5df-38fc-4d44-9f38-fbae08c80e81"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a6dd2796-9e9a-4ca2-9ba8-7c9029fb377d req-98f78beb-281f-494c-a0a7-9f71101cfcfe service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a6dd2796-9e9a-4ca2-9ba8-7c9029fb377d req-98f78beb-281f-494c-a0a7-9f71101cfcfe service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a6dd2796-9e9a-4ca2-9ba8-7c9029fb377d req-98f78beb-281f-494c-a0a7-9f71101cfcfe service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:18 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-a6dd2796-9e9a-4ca2-9ba8-7c9029fb377d req-98f78beb-281f-494c-a0a7-9f71101cfcfe service nova] Creating event network-vif-plugged:674fa5df-38fc-4d44-9f38-fbae08c80e81 for instance f094302b-0730-4754-b9e9-ec203312b8c0 on user Apr 14 15:37:18 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-a6dd2796-9e9a-4ca2-9ba8-7c9029fb377d req-98f78beb-281f-494c-a0a7-9f71101cfcfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044435 Apr 14 15:37:18 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 29/85] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-130551406", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "cc6790d7-04c1-4c9b-b432-822b3c71c178"}]}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] validate_networks() for [('cc6790d7-04c1-4c9b-b432-822b3c71c178', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:37:20 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1787128288", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "af630e01-6220-4496-8c7b-659dc25d39a2"}], "security_groups": [{"name": "tempest-securitygroup--1734877823"}], "key_name": "tempest-keypair-1198337819", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Getting quotas for project c377cd3ce1454ed5a6257138350802f6. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Getting quotas for user 426c9fdcd462435293f2208229c11458 and project c377cd3ce1454ed5a6257138350802f6. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:37:20 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-b2a5926a-6eca-4d2b-86a0-722d50eafce4 req-3083b037-f25f-4031-8938-a26922409edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f094302b-0730-4754-b9e9-ec203312b8c0", "name": "network-vif-plugged", "status": "completed", "tag": "674fa5df-38fc-4d44-9f38-fbae08c80e81"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:20 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] validate_networks() for [('af630e01-6220-4496-8c7b-659dc25d39a2', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:37:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-b2a5926a-6eca-4d2b-86a0-722d50eafce4 req-3083b037-f25f-4031-8938-a26922409edc service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-b2a5926a-6eca-4d2b-86a0-722d50eafce4 req-3083b037-f25f-4031-8938-a26922409edc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-b2a5926a-6eca-4d2b-86a0-722d50eafce4 req-3083b037-f25f-4031-8938-a26922409edc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.905742 Apr 14 15:37:20 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 31/86] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:37:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:37:20 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-b2a5926a-6eca-4d2b-86a0-722d50eafce4 req-3083b037-f25f-4031-8938-a26922409edc service nova] Creating event network-vif-plugged:674fa5df-38fc-4d44-9f38-fbae08c80e81 for instance f094302b-0730-4754-b9e9-ec203312b8c0 on user Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-96e74a60-1c34-4ced-a9e2-4dfe4a39c5df tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-96e74a60-1c34-4ced-a9e2-4dfe4a39c5df tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:37:20 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-b2a5926a-6eca-4d2b-86a0-722d50eafce4 req-3083b037-f25f-4031-8938-a26922409edc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071939 Apr 14 15:37:20 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 30/87] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:20 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-96e74a60-1c34-4ced-a9e2-4dfe4a39c5df tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426c9fdcd462435293f2208229c11458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c377cd3ce1454ed5a6257138350802f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-96e74a60-1c34-4ced-a9e2-4dfe4a39c5df tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" status: 200 len: 1207 microversion: 2.1 time: 0.081129 Apr 14 15:37:20 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 32/88] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:37:20 2023] GET /compute/v2.1/servers/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc => generated 1207 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Getting quotas for project ead92c17f9e64b90adac77a44a473bde. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Getting quotas for user 9a5a6a16abaa4c63b0220beb95fc9613 and project ead92c17f9e64b90adac77a44a473bde. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:37:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 0.883938 Apr 14 15:37:21 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 27/89] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 15:37:20 2023] POST /compute/v2.1/servers => generated 404 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 15:37:21 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:21 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-fd3a8e3e-71e7-4e8b-a08d-4eb808c52158 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:37:21 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-fd3a8e3e-71e7-4e8b-a08d-4eb808c52158 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:37:21 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-fd3a8e3e-71e7-4e8b-a08d-4eb808c52158 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:21 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-fd3a8e3e-71e7-4e8b-a08d-4eb808c52158 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:21 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-fd3a8e3e-71e7-4e8b-a08d-4eb808c52158 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:21 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-fd3a8e3e-71e7-4e8b-a08d-4eb808c52158 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5" status: 200 len: 1321 microversion: 2.49 time: 0.082221 Apr 14 15:37:21 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 31/90] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:37:21 2023] GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5 => generated 1321 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:37:21 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3", "tag": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:21 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-01f90c00-59c1-4216-a58f-8149cc056e5d tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:37:22 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-01f90c00-59c1-4216-a58f-8149cc056e5d tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:37:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:22 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] Creating event network-changed:9cb5e2c1-d5d0-4325-8847-6e18b178afbf for instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 on user Apr 14 15:37:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-01f90c00-59c1-4216-a58f-8149cc056e5d tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-01f90c00-59c1-4216-a58f-8149cc056e5d tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-01f90c00-59c1-4216-a58f-8149cc056e5d tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-01f90c00-59c1-4216-a58f-8149cc056e5d tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-01f90c00-59c1-4216-a58f-8149cc056e5d tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-01f90c00-59c1-4216-a58f-8149cc056e5d tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:22 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048950 Apr 14 15:37:22 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 33/91] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:22 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-01f90c00-59c1-4216-a58f-8149cc056e5d tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b4bd256ee41398d5fd89ef2191550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8097227d514468b100a6a637bb6287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:22 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-01f90c00-59c1-4216-a58f-8149cc056e5d tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6" status: 200 len: 1489 microversion: 2.1 time: 0.346341 Apr 14 15:37:22 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 28/92] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:37:21 2023] GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6 => generated 1489 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:37:22 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b57881-e95e-41d5-9f78-61d95ecfd93a", "tag": "3bdad8ab-4716-4bb3-b21e-890e392b5430"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:22 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] Creating event network-changed:3bdad8ab-4716-4bb3-b21e-890e392b5430 for instance 31b57881-e95e-41d5-9f78-61d95ecfd93a on user Apr 14 15:37:22 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059772 Apr 14 15:37:22 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 32/93] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:23 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-a219576c-ea2a-49d6-973e-644de09ae6a8 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:37:23 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-a219576c-ea2a-49d6-973e-644de09ae6a8 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:37:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a219576c-ea2a-49d6-973e-644de09ae6a8 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a219576c-ea2a-49d6-973e-644de09ae6a8 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a219576c-ea2a-49d6-973e-644de09ae6a8 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a219576c-ea2a-49d6-973e-644de09ae6a8 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a219576c-ea2a-49d6-973e-644de09ae6a8 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a219576c-ea2a-49d6-973e-644de09ae6a8 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:24 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-a219576c-ea2a-49d6-973e-644de09ae6a8 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af824b840c604223afd90bce17fe1ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e73ef2ad94e84876def53ddf43da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:24 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-a219576c-ea2a-49d6-973e-644de09ae6a8 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a" status: 200 len: 1494 microversion: 2.1 time: 0.471179 Apr 14 15:37:24 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 34/94] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:37:23 2023] GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a => generated 1494 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:37:24 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-520db906-3649-4054-b51c-a776842dd36d req-da392d0b-f460-4f67-9a10-476860efe145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b57881-e95e-41d5-9f78-61d95ecfd93a", "name": "network-vif-plugged", "status": "completed", "tag": "3bdad8ab-4716-4bb3-b21e-890e392b5430"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-520db906-3649-4054-b51c-a776842dd36d req-da392d0b-f460-4f67-9a10-476860efe145 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-520db906-3649-4054-b51c-a776842dd36d req-da392d0b-f460-4f67-9a10-476860efe145 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-520db906-3649-4054-b51c-a776842dd36d req-da392d0b-f460-4f67-9a10-476860efe145 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:24 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-520db906-3649-4054-b51c-a776842dd36d req-da392d0b-f460-4f67-9a10-476860efe145 service nova] Creating event network-vif-plugged:3bdad8ab-4716-4bb3-b21e-890e392b5430 for instance 31b57881-e95e-41d5-9f78-61d95ecfd93a on user Apr 14 15:37:24 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-520db906-3649-4054-b51c-a776842dd36d req-da392d0b-f460-4f67-9a10-476860efe145 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056587 Apr 14 15:37:24 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 29/95] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:24 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc", "tag": "e0c2ac1a-629d-4583-af53-a2fa5045c311"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] Creating event network-changed:e0c2ac1a-629d-4583-af53-a2fa5045c311 for instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc on user Apr 14 15:37:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050684 Apr 14 15:37:24 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 33/96] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:25 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "112ffb8d-fef8-4ffd-991c-626c7e4c85b5", "tag": "1f6caa20-5ea5-475a-8060-25725837c3c5"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] Creating event network-changed:1f6caa20-5ea5-475a-8060-25725837c3c5 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 on user Apr 14 15:37:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036778 Apr 14 15:37:25 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 35/97] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:26 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-bb38e54b-6b55-4ce9-9392-26a5f0947f24 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:37:26 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-bb38e54b-6b55-4ce9-9392-26a5f0947f24 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:37:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bb38e54b-6b55-4ce9-9392-26a5f0947f24 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bb38e54b-6b55-4ce9-9392-26a5f0947f24 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bb38e54b-6b55-4ce9-9392-26a5f0947f24 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bb38e54b-6b55-4ce9-9392-26a5f0947f24 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bb38e54b-6b55-4ce9-9392-26a5f0947f24 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bb38e54b-6b55-4ce9-9392-26a5f0947f24 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:26 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-bb38e54b-6b55-4ce9-9392-26a5f0947f24 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:26 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-bb38e54b-6b55-4ce9-9392-26a5f0947f24 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:26 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-bb38e54b-6b55-4ce9-9392-26a5f0947f24 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:26 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-bb38e54b-6b55-4ce9-9392-26a5f0947f24 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c" status: 200 len: 1690 microversion: 2.87 time: 0.443142 Apr 14 15:37:26 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 30/98] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:37:25 2023] GET /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c => generated 1690 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:37:26 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-02f5a539-d65a-4a8c-80d4-cd8ff178faf8 req-1f89ef17-201b-4aa0-bb59-cd1c1e5df6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b57881-e95e-41d5-9f78-61d95ecfd93a", "name": "network-vif-plugged", "status": "completed", "tag": "3bdad8ab-4716-4bb3-b21e-890e392b5430"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-02f5a539-d65a-4a8c-80d4-cd8ff178faf8 req-1f89ef17-201b-4aa0-bb59-cd1c1e5df6af service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-02f5a539-d65a-4a8c-80d4-cd8ff178faf8 req-1f89ef17-201b-4aa0-bb59-cd1c1e5df6af service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-02f5a539-d65a-4a8c-80d4-cd8ff178faf8 req-1f89ef17-201b-4aa0-bb59-cd1c1e5df6af service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:26 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-02f5a539-d65a-4a8c-80d4-cd8ff178faf8 req-1f89ef17-201b-4aa0-bb59-cd1c1e5df6af service nova] Creating event network-vif-plugged:3bdad8ab-4716-4bb3-b21e-890e392b5430 for instance 31b57881-e95e-41d5-9f78-61d95ecfd93a on user Apr 14 15:37:26 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-02f5a539-d65a-4a8c-80d4-cd8ff178faf8 req-1f89ef17-201b-4aa0-bb59-cd1c1e5df6af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028545 Apr 14 15:37:26 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 34/99] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:26 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3", "name": "network-vif-plugged", "status": "completed", "tag": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf"}, {"server_uuid": "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3", "name": "network-vif-plugged", "status": "completed", "tag": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:27 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] Creating event network-vif-plugged:9cb5e2c1-d5d0-4325-8847-6e18b178afbf for instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 on user Apr 14 15:37:27 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] Creating event network-vif-plugged:9cb5e2c1-d5d0-4325-8847-6e18b178afbf for instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 on user Apr 14 15:37:27 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036893 Apr 14 15:37:27 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 36/100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-e3934f0b-8adb-4632-9571-22ad676c9429 req-c1afe538-404c-4376-84e9-6675aca3eddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112ffb8d-fef8-4ffd-991c-626c7e4c85b5", "name": "network-vif-plugged", "status": "completed", "tag": "1f6caa20-5ea5-475a-8060-25725837c3c5"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-e3934f0b-8adb-4632-9571-22ad676c9429 req-c1afe538-404c-4376-84e9-6675aca3eddf service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-e3934f0b-8adb-4632-9571-22ad676c9429 req-c1afe538-404c-4376-84e9-6675aca3eddf service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-e3934f0b-8adb-4632-9571-22ad676c9429 req-c1afe538-404c-4376-84e9-6675aca3eddf service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-e3934f0b-8adb-4632-9571-22ad676c9429 req-c1afe538-404c-4376-84e9-6675aca3eddf service nova] Creating event network-vif-plugged:1f6caa20-5ea5-475a-8060-25725837c3c5 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 on user Apr 14 15:37:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-e3934f0b-8adb-4632-9571-22ad676c9429 req-c1afe538-404c-4376-84e9-6675aca3eddf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050627 Apr 14 15:37:28 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 31/101] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:29 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-b1846ad1-5dc0-4d1a-9255-29660e0c0fa3 req-786b53a5-7be5-4270-b389-77ce77ba2d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc", "name": "network-vif-plugged", "status": "completed", "tag": "e0c2ac1a-629d-4583-af53-a2fa5045c311"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-b1846ad1-5dc0-4d1a-9255-29660e0c0fa3 req-786b53a5-7be5-4270-b389-77ce77ba2d23 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-b1846ad1-5dc0-4d1a-9255-29660e0c0fa3 req-786b53a5-7be5-4270-b389-77ce77ba2d23 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-b1846ad1-5dc0-4d1a-9255-29660e0c0fa3 req-786b53a5-7be5-4270-b389-77ce77ba2d23 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:29 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-b1846ad1-5dc0-4d1a-9255-29660e0c0fa3 req-786b53a5-7be5-4270-b389-77ce77ba2d23 service nova] Creating event network-vif-plugged:e0c2ac1a-629d-4583-af53-a2fa5045c311 for instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc on user Apr 14 15:37:29 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-b1846ad1-5dc0-4d1a-9255-29660e0c0fa3 req-786b53a5-7be5-4270-b389-77ce77ba2d23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043003 Apr 14 15:37:29 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 35/102] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:30 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-dfcf6c4f-e00d-4713-821f-bbccd6278399 req-87fffc78-1af0-4e5d-9323-6ac5e8e53e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112ffb8d-fef8-4ffd-991c-626c7e4c85b5", "name": "network-vif-plugged", "status": "completed", "tag": "1f6caa20-5ea5-475a-8060-25725837c3c5"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-dfcf6c4f-e00d-4713-821f-bbccd6278399 req-87fffc78-1af0-4e5d-9323-6ac5e8e53e0d service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-dfcf6c4f-e00d-4713-821f-bbccd6278399 req-87fffc78-1af0-4e5d-9323-6ac5e8e53e0d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-dfcf6c4f-e00d-4713-821f-bbccd6278399 req-87fffc78-1af0-4e5d-9323-6ac5e8e53e0d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-dfcf6c4f-e00d-4713-821f-bbccd6278399 req-87fffc78-1af0-4e5d-9323-6ac5e8e53e0d service nova] Creating event network-vif-plugged:1f6caa20-5ea5-475a-8060-25725837c3c5 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 on user Apr 14 15:37:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-dfcf6c4f-e00d-4713-821f-bbccd6278399 req-87fffc78-1af0-4e5d-9323-6ac5e8e53e0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054276 Apr 14 15:37:30 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 37/103] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-64d16cb9-61be-4a17-8608-d2b19a1e427a req-83931f30-216c-40dd-8f11-27eaba4b7342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc", "name": "network-vif-plugged", "status": "completed", "tag": "e0c2ac1a-629d-4583-af53-a2fa5045c311"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-64d16cb9-61be-4a17-8608-d2b19a1e427a req-83931f30-216c-40dd-8f11-27eaba4b7342 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-64d16cb9-61be-4a17-8608-d2b19a1e427a req-83931f30-216c-40dd-8f11-27eaba4b7342 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-64d16cb9-61be-4a17-8608-d2b19a1e427a req-83931f30-216c-40dd-8f11-27eaba4b7342 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-64d16cb9-61be-4a17-8608-d2b19a1e427a req-83931f30-216c-40dd-8f11-27eaba4b7342 service nova] Creating event network-vif-plugged:e0c2ac1a-629d-4583-af53-a2fa5045c311 for instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc on user Apr 14 15:37:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-64d16cb9-61be-4a17-8608-d2b19a1e427a req-83931f30-216c-40dd-8f11-27eaba4b7342 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086351 Apr 14 15:37:31 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 32/104] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:34 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-08cbb6a6-580b-4684-b5b3-783e3fa5d57a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:37:34 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-08cbb6a6-580b-4684-b5b3-783e3fa5d57a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:37:34 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=18 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08cbb6a6-580b-4684-b5b3-783e3fa5d57a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08cbb6a6-580b-4684-b5b3-783e3fa5d57a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08cbb6a6-580b-4684-b5b3-783e3fa5d57a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08cbb6a6-580b-4684-b5b3-783e3fa5d57a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08cbb6a6-580b-4684-b5b3-783e3fa5d57a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08cbb6a6-580b-4684-b5b3-783e3fa5d57a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:35 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-08cbb6a6-580b-4684-b5b3-783e3fa5d57a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f805db20d87d4429981c975ebd88ed92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8230c5386464f288fd783b3c60536b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-08cbb6a6-580b-4684-b5b3-783e3fa5d57a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed" status: 200 len: 1550 microversion: 2.1 time: 0.702491 Apr 14 15:37:35 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 36/105] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:37:34 2023] GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed => generated 1550 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:37:36 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:36 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=16 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:36 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-b4d143f5-3720-48de-84da-3ec0e0256364 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:37:36 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-b4d143f5-3720-48de-84da-3ec0e0256364 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:37:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b4d143f5-3720-48de-84da-3ec0e0256364 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b4d143f5-3720-48de-84da-3ec0e0256364 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b4d143f5-3720-48de-84da-3ec0e0256364 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b4d143f5-3720-48de-84da-3ec0e0256364 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b4d143f5-3720-48de-84da-3ec0e0256364 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b4d143f5-3720-48de-84da-3ec0e0256364 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:37 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-b4d143f5-3720-48de-84da-3ec0e0256364 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-b4d143f5-3720-48de-84da-3ec0e0256364 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c" status: 200 len: 1503 microversion: 2.1 time: 0.525275 Apr 14 15:37:37 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 38/106] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:37:36 2023] GET /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c => generated 1503 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:37:44 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5a14da0e-dbb2-42af-8a67-b046a1f8dc65 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Action: 'create', calling method: .version_select at 0x7f2970f30c10>, body: {"keypair": {"name": "tempest-keypair-1185062635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA=="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:44 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:44 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=18 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:44 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=7 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:44 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=22 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:44 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-5a14da0e-dbb2-42af-8a67-b046a1f8dc65 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Getting quotas for project dad6fcd223054486a97d9cbc369eff77. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:37:44 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-5a14da0e-dbb2-42af-8a67-b046a1f8dc65 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Getting quotas for user 063d123ffa4f4695bcec3583831b6097 and project dad6fcd223054486a97d9cbc369eff77. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:37:44 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5a14da0e-dbb2-42af-8a67-b046a1f8dc65 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.107900 Apr 14 15:37:44 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 33/107] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 15:37:44 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 15:37:46 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2050643769", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "3d074737-eaab-4926-93e7-2dd046760ec2"}, {"port": "6a76a230-e352-46c5-bec1-7d283ac41b19", "tag": "port-1"}, {"port": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "tag": "port-2"}, {"uuid": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "tag": "net-1"}, {"uuid": "60c38bcb-c6b7-4866-89d0-04a4485005ad"}, {"uuid": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "0b929b4b-4f60-46e7-8bda-cb3079ee10c5", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e976a7ef-4ab8-4174-9a2a-c80fb2cafae9", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1969995092"}], "key_name": "tempest-keypair-1185062635", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:46 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=5 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:46 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=20 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:46 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] validate_networks() for [('3d074737-eaab-4926-93e7-2dd046760ec2', None, None, None, None, None), (None, None, '6a76a230-e352-46c5-bec1-7d283ac41b19', None, None, None), (None, None, '67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7', None, None, None), ('60c38bcb-c6b7-4866-89d0-04a4485005ad', None, None, None, None, None), ('60c38bcb-c6b7-4866-89d0-04a4485005ad', None, None, None, None, None), ('c5b2412a-87f1-4ede-ad44-4a966ccbe61d', '10.2.2.100', None, None, None, None), ('c5b2412a-87f1-4ede-ad44-4a966ccbe61d', '10.2.2.200', None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:37:48 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-01ba75d7-c1f1-40dc-95e4-36b2ea3363b3 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Action: 'create', calling method: .version_select at 0x7f2970f41b40>, body: {"keypair": {"name": "tempest-keypair-1774536726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA=="}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:48 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:48 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=26 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:37:48 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-01ba75d7-c1f1-40dc-95e4-36b2ea3363b3 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Getting quotas for project 140cbbc3a56d44eb99f7759080f26fcb. Resources: {'key_pairs'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:37:48 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-01ba75d7-c1f1-40dc-95e4-36b2ea3363b3 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Getting quotas for user d16729d95f2742578646f5b33dedb48b and project 140cbbc3a56d44eb99f7759080f26fcb. Resources: {'key_pairs'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:37:48 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-01ba75d7-c1f1-40dc-95e4-36b2ea3363b3 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.052349 Apr 14 15:37:48 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 39/108] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 15:37:48 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Getting quotas for project dad6fcd223054486a97d9cbc369eff77. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Getting quotas for user 063d123ffa4f4695bcec3583831b6097 and project dad6fcd223054486a97d9cbc369eff77. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:37:49 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='0b929b4b-4f60-46e7-8bda-cb3079ee10c5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e976a7ef-4ab8-4174-9a2a-c80fb2cafae9',volume_size=None,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:37:49 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1771574519", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a98b667f-24db-49be-b60a-2e6ed4a34a06"}, {"port": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "tag": "port-1"}, {"port": "a1397aaf-d530-448a-9827-824d37cf44ba", "tag": "port-2"}, {"uuid": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "tag": "net-1"}, {"uuid": "b300262e-c72a-4c44-90a1-f7265ed8d9dc"}, {"uuid": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "589fab96-d1de-4727-b5f3-99d4eb88c71d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c3b561cc-fb98-4e4b-ac5a-5f62afb45279", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "890966d3-36f7-4957-82e8-fda81c2dcd11", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1681872867"}], "key_name": "tempest-keypair-1774536726", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 3.707341 Apr 14 15:37:49 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 37/109] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 15:37:46 2023] POST /compute/v2.1/servers => generated 404 bytes in 3709 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 15:37:49 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-34bbbaaa-fdef-4291-b978-0b60ee223bf4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:37:49 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-34bbbaaa-fdef-4291-b978-0b60ee223bf4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:37:49 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] validate_networks() for [('a98b667f-24db-49be-b60a-2e6ed4a34a06', None, None, None, None, None), (None, None, '4df8fbd5-6858-4d05-b89b-9d3a4d9ed773', None, None, None), (None, None, 'a1397aaf-d530-448a-9827-824d37cf44ba', None, None, None), ('b300262e-c72a-4c44-90a1-f7265ed8d9dc', None, None, None, None, None), ('b300262e-c72a-4c44-90a1-f7265ed8d9dc', None, None, None, None, None), ('575229c8-5d8a-45e4-b493-8c592f1f6a6b', '10.2.2.100', None, None, None, None), ('575229c8-5d8a-45e4-b493-8c592f1f6a6b', '10.2.2.200', None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:37:49 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-34bbbaaa-fdef-4291-b978-0b60ee223bf4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063d123ffa4f4695bcec3583831b6097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6fcd223054486a97d9cbc369eff77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:49 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-34bbbaaa-fdef-4291-b978-0b60ee223bf4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063d123ffa4f4695bcec3583831b6097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6fcd223054486a97d9cbc369eff77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:49 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-34bbbaaa-fdef-4291-b978-0b60ee223bf4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063d123ffa4f4695bcec3583831b6097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6fcd223054486a97d9cbc369eff77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:49 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-34bbbaaa-fdef-4291-b978-0b60ee223bf4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa" status: 200 len: 1280 microversion: 2.42 time: 0.072228 Apr 14 15:37:49 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 40/110] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:37:49 2023] GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:37:51 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:37:51 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:37:51 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:37:51 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:37:51 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:37:51 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:51 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:51 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:51 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:51 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:51 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:51 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Getting quotas for project 140cbbc3a56d44eb99f7759080f26fcb. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:37:51 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Getting quotas for user d16729d95f2742578646f5b33dedb48b and project 140cbbc3a56d44eb99f7759080f26fcb. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:37:52 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:37:52 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='589fab96-d1de-4727-b5f3-99d4eb88c71d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c3b561cc-fb98-4e4b-ac5a-5f62afb45279',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='890966d3-36f7-4957-82e8-fda81c2dcd11',volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:37:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 2.922010 Apr 14 15:37:52 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 34/111] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 15:37:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 2924 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 15:37:52 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-96548dfe-b719-48fd-838d-3b2242332d3d tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:37:52 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-96548dfe-b719-48fd-838d-3b2242332d3d tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:37:52 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-96548dfe-b719-48fd-838d-3b2242332d3d tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16729d95f2742578646f5b33dedb48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140cbbc3a56d44eb99f7759080f26fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:52 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-96548dfe-b719-48fd-838d-3b2242332d3d tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd16729d95f2742578646f5b33dedb48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140cbbc3a56d44eb99f7759080f26fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:52 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-96548dfe-b719-48fd-838d-3b2242332d3d tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd16729d95f2742578646f5b33dedb48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140cbbc3a56d44eb99f7759080f26fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:37:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-96548dfe-b719-48fd-838d-3b2242332d3d tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2" status: 200 len: 1280 microversion: 2.32 time: 0.151736 Apr 14 15:37:52 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 38/112] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:37:52 2023] GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2 => generated 1280 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:37:56 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "tag": "a5007998-31ee-4618-9fde-ab538bbd8e76"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:56 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:56 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:56 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:56 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] Creating event network-changed:a5007998-31ee-4618-9fde-ab538bbd8e76 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:37:56 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030123 Apr 14 15:37:56 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 41/113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:58 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "tag": "6a76a230-e352-46c5-bec1-7d283ac41b19"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:58 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:58 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:58 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:58 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] Creating event network-changed:6a76a230-e352-46c5-bec1-7d283ac41b19 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:37:58 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031191 Apr 14 15:37:58 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 35/114] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:37:59 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "tag": "ee1af132-bea9-465f-8b76-264c96b3f02b"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:37:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:37:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:37:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:37:59 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] Creating event network-changed:ee1af132-bea9-465f-8b76-264c96b3f02b for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:37:59 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028929 Apr 14 15:37:59 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 39/115] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:37:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:00 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:00 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "tag": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7"}, {"name": "network-changed", "server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "tag": "a73bbd65-caef-437c-abd9-6d2ccc977830"}, {"name": "network-changed", "server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "tag": "e2de16b7-a60f-4fba-ace4-21ab648d036e"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:00 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:00 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:00 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:00 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Creating event network-changed:67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:00 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Creating event network-changed:a73bbd65-caef-437c-abd9-6d2ccc977830 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:00 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Creating event network-changed:e2de16b7-a60f-4fba-ace4-21ab648d036e for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:00 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.038537 Apr 14 15:38:00 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 42/116] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:00 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:01 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "tag": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773"}, {"name": "network-changed", "server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "tag": "a1397aaf-d530-448a-9827-824d37cf44ba"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] Creating event network-changed:4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] Creating event network-changed:a1397aaf-d530-448a-9827-824d37cf44ba for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031258 Apr 14 15:38:01 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 36/117] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:01 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:01 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:01 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-16df7441-f497-4791-acba-c5358b888310 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:01 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-16df7441-f497-4791-acba-c5358b888310 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:01 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-16df7441-f497-4791-acba-c5358b888310 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:01 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-16df7441-f497-4791-acba-c5358b888310 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:01 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-16df7441-f497-4791-acba-c5358b888310 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:01 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-16df7441-f497-4791-acba-c5358b888310 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:01 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-16df7441-f497-4791-acba-c5358b888310 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:01 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-16df7441-f497-4791-acba-c5358b888310 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:02 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-16df7441-f497-4791-acba-c5358b888310 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1aa921f86bd4f3b88eb782d5f667816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '029b8c395f264a86933a9e878c18e0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-16df7441-f497-4791-acba-c5358b888310 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0" status: 200 len: 1544 microversion: 2.1 time: 0.515747 Apr 14 15:38:02 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 40/118] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:38:01 2023] GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0 => generated 1544 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:38:02 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "tag": "ecc253cf-3d0b-4f54-8f5b-f3520753f121"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:02 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] Creating event network-changed:ecc253cf-3d0b-4f54-8f5b-f3520753f121 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:02 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031922 Apr 14 15:38:02 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 43/119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:03 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "tag": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:03 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:03 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=10 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:03 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] Creating event network-changed:d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:03 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033277 Apr 14 15:38:03 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 37/120] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:04 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "tag": "f10a6caa-5805-4f6b-9082-7835563229c1"}, {"name": "network-changed", "server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "tag": "6092e2c0-2114-4909-aeca-bb8b43a1c220"}, {"name": "network-changed", "server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "tag": "25141225-c1dd-4587-8056-04b3c44668c6"}, {"name": "network-changed", "server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "tag": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:04 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=8 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Creating event network-changed:f10a6caa-5805-4f6b-9082-7835563229c1 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Creating event network-changed:6092e2c0-2114-4909-aeca-bb8b43a1c220 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Creating event network-changed:25141225-c1dd-4587-8056-04b3c44668c6 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Creating event network-changed:a7786e2f-3d52-4ec4-8e66-9221db2c3e3e for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 680 microversion: 2.1 time: 0.038801 Apr 14 15:38:04 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 41/121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:04 2023] POST /compute/v2.1/os-server-external-events => generated 680 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-c2cfe185-5934-4788-9fc2-04350ea19e0d tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:07 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-c2cfe185-5934-4788-9fc2-04350ea19e0d tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c2cfe185-5934-4788-9fc2-04350ea19e0d tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c2cfe185-5934-4788-9fc2-04350ea19e0d tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c2cfe185-5934-4788-9fc2-04350ea19e0d tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c2cfe185-5934-4788-9fc2-04350ea19e0d tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c2cfe185-5934-4788-9fc2-04350ea19e0d tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c2cfe185-5934-4788-9fc2-04350ea19e0d tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:07 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-c2cfe185-5934-4788-9fc2-04350ea19e0d tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8903273cb7ea4a0c9831dbcc74361ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eb038f3914d54a892a6dabdf6f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-c2cfe185-5934-4788-9fc2-04350ea19e0d tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a" status: 200 len: 1524 microversion: 2.1 time: 0.218698 Apr 14 15:38:07 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 44/122] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:38:07 2023] GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a => generated 1524 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:38:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ccb4cf98-4e63-4084-bc17-dd92bce17926 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:08 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ccb4cf98-4e63-4084-bc17-dd92bce17926 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ccb4cf98-4e63-4084-bc17-dd92bce17926 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ccb4cf98-4e63-4084-bc17-dd92bce17926 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ccb4cf98-4e63-4084-bc17-dd92bce17926 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ccb4cf98-4e63-4084-bc17-dd92bce17926 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ccb4cf98-4e63-4084-bc17-dd92bce17926 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ccb4cf98-4e63-4084-bc17-dd92bce17926 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:08 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-ccb4cf98-4e63-4084-bc17-dd92bce17926 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4611274a77c4f3a8333771568ce9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02da33469a7a477b876331e9b846b99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ccb4cf98-4e63-4084-bc17-dd92bce17926 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" status: 200 len: 1547 microversion: 2.1 time: 0.250109 Apr 14 15:38:08 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 38/123] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:38:08 2023] GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 => generated 1547 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:38:10 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3e66c3b0-f23e-42ec-8113-822ed59ad58e tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:10 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-3e66c3b0-f23e-42ec-8113-822ed59ad58e tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3e66c3b0-f23e-42ec-8113-822ed59ad58e tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3e66c3b0-f23e-42ec-8113-822ed59ad58e tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3e66c3b0-f23e-42ec-8113-822ed59ad58e tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3e66c3b0-f23e-42ec-8113-822ed59ad58e tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3e66c3b0-f23e-42ec-8113-822ed59ad58e tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3e66c3b0-f23e-42ec-8113-822ed59ad58e tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:11 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-3e66c3b0-f23e-42ec-8113-822ed59ad58e tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426c9fdcd462435293f2208229c11458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c377cd3ce1454ed5a6257138350802f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:11 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-3e66c3b0-f23e-42ec-8113-822ed59ad58e tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" status: 200 len: 1485 microversion: 2.1 time: 0.294247 Apr 14 15:38:11 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 42/124] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:38:10 2023] GET /compute/v2.1/servers/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc => generated 1485 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:38:11 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-34451fff-7f12-4213-b64b-d93598ee2bdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:11 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-34451fff-7f12-4213-b64b-d93598ee2bdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:11 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-34451fff-7f12-4213-b64b-d93598ee2bdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:11 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-34451fff-7f12-4213-b64b-d93598ee2bdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:11 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-34451fff-7f12-4213-b64b-d93598ee2bdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:11 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-34451fff-7f12-4213-b64b-d93598ee2bdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:11 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-34451fff-7f12-4213-b64b-d93598ee2bdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:11 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-34451fff-7f12-4213-b64b-d93598ee2bdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:11 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-34451fff-7f12-4213-b64b-d93598ee2bdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:11 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-34451fff-7f12-4213-b64b-d93598ee2bdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:11 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-34451fff-7f12-4213-b64b-d93598ee2bdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:11 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-34451fff-7f12-4213-b64b-d93598ee2bdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5" status: 200 len: 1628 microversion: 2.49 time: 0.308234 Apr 14 15:38:11 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 45/125] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:38:11 2023] GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5 => generated 1628 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1018319414", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40"}]}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=14 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] validate_networks() for [('dd14d44b-4a04-4aa4-9dfd-1933f29c3a40', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:24 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32a1af86-5017-4ea9-a4c5-15ac5b26cdd6"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:24 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:24 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:24 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=18 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Getting quotas for project 3a8e73ef2ad94e84876def53ddf43da4. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:38:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Getting quotas for user af824b840c604223afd90bce17fe1ceb and project 3a8e73ef2ad94e84876def53ddf43da4. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:38:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:38:24 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:38:24 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.607404 Apr 14 15:38:24 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 39/126] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:38:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:38:24 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4f1ac078-7180-4c90-9097-c2cb8ba58e2a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:24 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-4f1ac078-7180-4c90-9097-c2cb8ba58e2a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:24 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:24 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=18 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:25 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-4f1ac078-7180-4c90-9097-c2cb8ba58e2a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af824b840c604223afd90bce17fe1ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e73ef2ad94e84876def53ddf43da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-4f1ac078-7180-4c90-9097-c2cb8ba58e2a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" status: 200 len: 1211 microversion: 2.1 time: 0.081335 Apr 14 15:38:25 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 46/127] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:38:24 2023] GET /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:38:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.850169 Apr 14 15:38:25 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 43/128] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:38:24 2023] POST /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6/os-volume_attachments => generated 194 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:25 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-fe684330-4c2e-44ce-aec9-3aac4ce76331 req-193069f0-9749-401d-81c4-3ed8122253ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "a5007998-31ee-4618-9fde-ab538bbd8e76"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-fe684330-4c2e-44ce-aec9-3aac4ce76331 req-193069f0-9749-401d-81c4-3ed8122253ff service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-fe684330-4c2e-44ce-aec9-3aac4ce76331 req-193069f0-9749-401d-81c4-3ed8122253ff service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-fe684330-4c2e-44ce-aec9-3aac4ce76331 req-193069f0-9749-401d-81c4-3ed8122253ff service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:26 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-fe684330-4c2e-44ce-aec9-3aac4ce76331 req-193069f0-9749-401d-81c4-3ed8122253ff service nova] Creating event network-vif-plugged:a5007998-31ee-4618-9fde-ab538bbd8e76 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:26 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-fe684330-4c2e-44ce-aec9-3aac4ce76331 req-193069f0-9749-401d-81c4-3ed8122253ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047264 Apr 14 15:38:26 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 40/129] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:26 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-f3398706-c762-4bbb-9939-6306bb76d4ee req-56eb0b60-eb25-45e4-b6f3-404adfa619f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "6a76a230-e352-46c5-bec1-7d283ac41b19"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f3398706-c762-4bbb-9939-6306bb76d4ee req-56eb0b60-eb25-45e4-b6f3-404adfa619f0 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f3398706-c762-4bbb-9939-6306bb76d4ee req-56eb0b60-eb25-45e4-b6f3-404adfa619f0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f3398706-c762-4bbb-9939-6306bb76d4ee req-56eb0b60-eb25-45e4-b6f3-404adfa619f0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:26 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-f3398706-c762-4bbb-9939-6306bb76d4ee req-56eb0b60-eb25-45e4-b6f3-404adfa619f0 service nova] Creating event network-vif-plugged:6a76a230-e352-46c5-bec1-7d283ac41b19 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:26 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-f3398706-c762-4bbb-9939-6306bb76d4ee req-56eb0b60-eb25-45e4-b6f3-404adfa619f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034069 Apr 14 15:38:26 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 47/130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:26 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1543084448"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:26 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:26 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-77b306da-1fe5-40ae-9b54-5b78a97663a9 req-6fe5f1e8-125b-4fc1-b60a-62ffbdbd5ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-77b306da-1fe5-40ae-9b54-5b78a97663a9 req-6fe5f1e8-125b-4fc1-b60a-62ffbdbd5ec9 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-77b306da-1fe5-40ae-9b54-5b78a97663a9 req-6fe5f1e8-125b-4fc1-b60a-62ffbdbd5ec9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-77b306da-1fe5-40ae-9b54-5b78a97663a9 req-6fe5f1e8-125b-4fc1-b60a-62ffbdbd5ec9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:26 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-77b306da-1fe5-40ae-9b54-5b78a97663a9 req-6fe5f1e8-125b-4fc1-b60a-62ffbdbd5ec9 service nova] Creating event network-vif-plugged:67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:26 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-77b306da-1fe5-40ae-9b54-5b78a97663a9 req-6fe5f1e8-125b-4fc1-b60a-62ffbdbd5ec9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035501 Apr 14 15:38:26 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 41/131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:27 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/action" status: 202 len: 52 microversion: 2.87 time: 1.163279 Apr 14 15:38:27 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 44/132] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 15:38:26 2023] POST /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/action => generated 52 bytes in 1166 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 15:38:28 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "a5007998-31ee-4618-9fde-ab538bbd8e76"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "e2de16b7-a60f-4fba-ace4-21ab648d036e"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "e2de16b7-a60f-4fba-ace4-21ab648d036e"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:28 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Creating event network-vif-plugged:a5007998-31ee-4618-9fde-ab538bbd8e76 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:28 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Creating event network-vif-plugged:e2de16b7-a60f-4fba-ace4-21ab648d036e for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:28 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Creating event network-vif-plugged:e2de16b7-a60f-4fba-ace4-21ab648d036e for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:28 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035914 Apr 14 15:38:28 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 48/133] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:28 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:38:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "6a76a230-e352-46c5-bec1-7d283ac41b19"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "a73bbd65-caef-437c-abd9-6d2ccc977830"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "a73bbd65-caef-437c-abd9-6d2ccc977830"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Creating event network-vif-plugged:6a76a230-e352-46c5-bec1-7d283ac41b19 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Creating event network-vif-plugged:a73bbd65-caef-437c-abd9-6d2ccc977830 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Creating event network-vif-plugged:a73bbd65-caef-437c-abd9-6d2ccc977830 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.034717 Apr 14 15:38:28 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 42/134] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:28 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "ecc253cf-3d0b-4f54-8f5b-f3520753f121"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "ecc253cf-3d0b-4f54-8f5b-f3520753f121"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "f10a6caa-5805-4f6b-9082-7835563229c1"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Creating event network-vif-plugged:67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Creating event network-vif-plugged:ecc253cf-3d0b-4f54-8f5b-f3520753f121 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Creating event network-vif-plugged:ecc253cf-3d0b-4f54-8f5b-f3520753f121 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Creating event network-vif-plugged:f10a6caa-5805-4f6b-9082-7835563229c1 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.049041 Apr 14 15:38:28 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 45/135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:28 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:30 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62", "tag": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] Creating event network-changed:2a5e9f47-a62f-4feb-be9c-2a4bc943c378 for instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 on user Apr 14 15:38:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060131 Apr 14 15:38:30 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 49/136] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:30 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-6a6b1162-9e9a-4b39-bdb2-9d636fb7a4ec req-8453f75d-a474-4d31-8375-2deb6ba08e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "f10a6caa-5805-4f6b-9082-7835563229c1"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6a6b1162-9e9a-4b39-bdb2-9d636fb7a4ec req-8453f75d-a474-4d31-8375-2deb6ba08e82 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6a6b1162-9e9a-4b39-bdb2-9d636fb7a4ec req-8453f75d-a474-4d31-8375-2deb6ba08e82 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6a6b1162-9e9a-4b39-bdb2-9d636fb7a4ec req-8453f75d-a474-4d31-8375-2deb6ba08e82 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:30 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-6a6b1162-9e9a-4b39-bdb2-9d636fb7a4ec req-8453f75d-a474-4d31-8375-2deb6ba08e82 service nova] Creating event network-vif-plugged:f10a6caa-5805-4f6b-9082-7835563229c1 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:38:30 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-6a6b1162-9e9a-4b39-bdb2-9d636fb7a4ec req-8453f75d-a474-4d31-8375-2deb6ba08e82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065313 Apr 14 15:38:30 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 43/137] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:32 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "a1397aaf-d530-448a-9827-824d37cf44ba"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "a1397aaf-d530-448a-9827-824d37cf44ba"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Creating event network-vif-plugged:4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Creating event network-vif-plugged:4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Creating event network-vif-plugged:a1397aaf-d530-448a-9827-824d37cf44ba for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Creating event network-vif-plugged:a1397aaf-d530-448a-9827-824d37cf44ba for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.044646 Apr 14 15:38:32 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 46/138] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:32 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:32 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "ee1af132-bea9-465f-8b76-264c96b3f02b"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "ee1af132-bea9-465f-8b76-264c96b3f02b"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:32 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] Creating event network-vif-plugged:ee1af132-bea9-465f-8b76-264c96b3f02b for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:32 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] Creating event network-vif-plugged:ee1af132-bea9-465f-8b76-264c96b3f02b for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:32 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040719 Apr 14 15:38:32 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 50/139] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:33 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-b9696ccb-3355-450b-90f2-871d922bcf32 req-ff1e4eec-9aba-4e73-8cd5-bb5f5f9c3d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "25141225-c1dd-4587-8056-04b3c44668c6"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b9696ccb-3355-450b-90f2-871d922bcf32 req-ff1e4eec-9aba-4e73-8cd5-bb5f5f9c3d51 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b9696ccb-3355-450b-90f2-871d922bcf32 req-ff1e4eec-9aba-4e73-8cd5-bb5f5f9c3d51 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b9696ccb-3355-450b-90f2-871d922bcf32 req-ff1e4eec-9aba-4e73-8cd5-bb5f5f9c3d51 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:33 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-b9696ccb-3355-450b-90f2-871d922bcf32 req-ff1e4eec-9aba-4e73-8cd5-bb5f5f9c3d51 service nova] Creating event network-vif-plugged:25141225-c1dd-4587-8056-04b3c44668c6 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:33 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-b9696ccb-3355-450b-90f2-871d922bcf32 req-ff1e4eec-9aba-4e73-8cd5-bb5f5f9c3d51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040495 Apr 14 15:38:33 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 44/140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:34 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-414eb360-9660-410a-b425-0457384edc93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:34 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-414eb360-9660-410a-b425-0457384edc93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-414eb360-9660-410a-b425-0457384edc93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-414eb360-9660-410a-b425-0457384edc93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-414eb360-9660-410a-b425-0457384edc93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-414eb360-9660-410a-b425-0457384edc93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-414eb360-9660-410a-b425-0457384edc93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-414eb360-9660-410a-b425-0457384edc93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:34 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-414eb360-9660-410a-b425-0457384edc93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:34 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-414eb360-9660-410a-b425-0457384edc93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:34 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-414eb360-9660-410a-b425-0457384edc93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:34 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-414eb360-9660-410a-b425-0457384edc93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c" status: 200 len: 1703 microversion: 2.87 time: 0.513537 Apr 14 15:38:34 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 47/141] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:38:34 2023] GET /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c => generated 1703 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:38:34 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:34 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62", "name": "network-vif-plugged", "status": "completed", "tag": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378"}, {"server_uuid": "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62", "name": "network-vif-plugged", "status": "completed", "tag": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "6092e2c0-2114-4909-aeca-bb8b43a1c220"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "6092e2c0-2114-4909-aeca-bb8b43a1c220"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:34 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Creating event network-vif-plugged:2a5e9f47-a62f-4feb-be9c-2a4bc943c378 for instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 on user Apr 14 15:38:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Creating event network-vif-plugged:2a5e9f47-a62f-4feb-be9c-2a4bc943c378 for instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 on user Apr 14 15:38:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Creating event network-vif-plugged:6092e2c0-2114-4909-aeca-bb8b43a1c220 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Creating event network-vif-plugged:6092e2c0-2114-4909-aeca-bb8b43a1c220 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Creating event network-vif-plugged:a7786e2f-3d52-4ec4-8e66-9221db2c3e3e for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Creating event network-vif-plugged:a7786e2f-3d52-4ec4-8e66-9221db2c3e3e for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:34 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.077000 Apr 14 15:38:34 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 45/142] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:34 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:38:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] Creating event network-vif-plugged:d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] Creating event network-vif-plugged:d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.421442 Apr 14 15:38:34 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 51/143] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:35 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-03af0ed5-7725-4753-b7f4-69665428a946 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:35 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-03af0ed5-7725-4753-b7f4-69665428a946 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-03af0ed5-7725-4753-b7f4-69665428a946 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-03af0ed5-7725-4753-b7f4-69665428a946 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-03af0ed5-7725-4753-b7f4-69665428a946 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-03af0ed5-7725-4753-b7f4-69665428a946 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-03af0ed5-7725-4753-b7f4-69665428a946 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-03af0ed5-7725-4753-b7f4-69665428a946 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-03af0ed5-7725-4753-b7f4-69665428a946 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.216404 Apr 14 15:38:35 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 48/144] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 15:38:35 2023] GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/os-interface => generated 282 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:35 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:35 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:35 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Going to try to terminate instance {{(pid=61876) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:38:35 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:38:35 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-224684c9-35ad-474d-afb0-aa0739509e64 req-34061b1e-6a7e-425b-97d0-55c549aed52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "25141225-c1dd-4587-8056-04b3c44668c6"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-224684c9-35ad-474d-afb0-aa0739509e64 req-34061b1e-6a7e-425b-97d0-55c549aed52a service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-224684c9-35ad-474d-afb0-aa0739509e64 req-34061b1e-6a7e-425b-97d0-55c549aed52a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-224684c9-35ad-474d-afb0-aa0739509e64 req-34061b1e-6a7e-425b-97d0-55c549aed52a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:35 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-224684c9-35ad-474d-afb0-aa0739509e64 req-34061b1e-6a7e-425b-97d0-55c549aed52a service nova] Creating event network-vif-plugged:25141225-c1dd-4587-8056-04b3c44668c6 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:38:35 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-224684c9-35ad-474d-afb0-aa0739509e64 req-34061b1e-6a7e-425b-97d0-55c549aed52a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041348 Apr 14 15:38:35 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 52/145] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:36 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6" status: 204 len: 0 microversion: 2.1 time: 0.510306 Apr 14 15:38:36 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 46/146] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:38:35 2023] DELETE /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:38:36 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6f2c2dc8-689a-4cee-be20-d41d581b09d7 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:36 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-6f2c2dc8-689a-4cee-be20-d41d581b09d7 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6f2c2dc8-689a-4cee-be20-d41d581b09d7 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6f2c2dc8-689a-4cee-be20-d41d581b09d7 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6f2c2dc8-689a-4cee-be20-d41d581b09d7 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6f2c2dc8-689a-4cee-be20-d41d581b09d7 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6f2c2dc8-689a-4cee-be20-d41d581b09d7 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6f2c2dc8-689a-4cee-be20-d41d581b09d7 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:36 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-6f2c2dc8-689a-4cee-be20-d41d581b09d7 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b4bd256ee41398d5fd89ef2191550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8097227d514468b100a6a637bb6287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-6f2c2dc8-689a-4cee-be20-d41d581b09d7 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6" status: 200 len: 1541 microversion: 2.1 time: 0.405617 Apr 14 15:38:36 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 49/147] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:38:36 2023] GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6 => generated 1541 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:38:37 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-3d68fcc7-64a9-48cf-b7da-caa0d1988e21 req-b3df4d13-28a1-4739-a4ab-ba036248771b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66b5102-c56e-4209-afb2-c2594b271af6", "name": "network-vif-unplugged", "status": "completed", "tag": "4b57e07f-f5a9-4524-9f4a-f97133808b99"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-3d68fcc7-64a9-48cf-b7da-caa0d1988e21 req-b3df4d13-28a1-4739-a4ab-ba036248771b service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-3d68fcc7-64a9-48cf-b7da-caa0d1988e21 req-b3df4d13-28a1-4739-a4ab-ba036248771b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-3d68fcc7-64a9-48cf-b7da-caa0d1988e21 req-b3df4d13-28a1-4739-a4ab-ba036248771b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-3d68fcc7-64a9-48cf-b7da-caa0d1988e21 req-b3df4d13-28a1-4739-a4ab-ba036248771b service nova] Creating event network-vif-unplugged:4b57e07f-f5a9-4524-9f4a-f97133808b99 for instance c66b5102-c56e-4209-afb2-c2594b271af6 on user Apr 14 15:38:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-3d68fcc7-64a9-48cf-b7da-caa0d1988e21 req-b3df4d13-28a1-4739-a4ab-ba036248771b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057190 Apr 14 15:38:37 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 53/148] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:38:37 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:37 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:37 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'flavor' on Instance uuid 40b5c2de-9cb2-4bcc-a04a-a4924e51151c {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:38:37 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "POST /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/action" status: 200 len: 32 microversion: 2.1 time: 0.190061 Apr 14 15:38:37 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 47/149] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:38:37 2023] POST /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:38:37 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-2a19723c-538c-440f-ad19-f8faccb0d5ae tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:37 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-2a19723c-538c-440f-ad19-f8faccb0d5ae tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:37 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2a19723c-538c-440f-ad19-f8faccb0d5ae tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:37 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2a19723c-538c-440f-ad19-f8faccb0d5ae tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:37 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2a19723c-538c-440f-ad19-f8faccb0d5ae tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:37 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2a19723c-538c-440f-ad19-f8faccb0d5ae tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:37 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2a19723c-538c-440f-ad19-f8faccb0d5ae tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:37 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2a19723c-538c-440f-ad19-f8faccb0d5ae tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:37 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-2095690299"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:37 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:37 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:37 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] Creating event network-changed:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:38:37 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042979 Apr 14 15:38:37 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 48/150] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:38 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-2a19723c-538c-440f-ad19-f8faccb0d5ae tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-2a19723c-538c-440f-ad19-f8faccb0d5ae tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c" status: 200 len: 1509 microversion: 2.1 time: 0.513010 Apr 14 15:38:38 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 50/151] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:38:37 2023] GET /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c => generated 1509 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:38:38 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-67238632-ac01-451c-8f29-17875c355e09 req-43ce6aee-d386-4d37-863c-b2c47fa61a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66b5102-c56e-4209-afb2-c2594b271af6", "name": "network-vif-deleted", "tag": "4b57e07f-f5a9-4524-9f4a-f97133808b99"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-67238632-ac01-451c-8f29-17875c355e09 req-43ce6aee-d386-4d37-863c-b2c47fa61a98 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-67238632-ac01-451c-8f29-17875c355e09 req-43ce6aee-d386-4d37-863c-b2c47fa61a98 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-67238632-ac01-451c-8f29-17875c355e09 req-43ce6aee-d386-4d37-863c-b2c47fa61a98 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:38 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-67238632-ac01-451c-8f29-17875c355e09 req-43ce6aee-d386-4d37-863c-b2c47fa61a98 service nova] Creating event network-vif-deleted:4b57e07f-f5a9-4524-9f4a-f97133808b99 for instance c66b5102-c56e-4209-afb2-c2594b271af6 on user Apr 14 15:38:38 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-67238632-ac01-451c-8f29-17875c355e09 req-43ce6aee-d386-4d37-863c-b2c47fa61a98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054541 Apr 14 15:38:38 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 49/152] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:39 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/action" status: 202 len: 0 microversion: 2.1 time: 1.251574 Apr 14 15:38:39 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 54/153] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:38:37 2023] POST /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/action => generated 0 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 15:38:39 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-ce0420f7-3e28-4d90-bfaa-2c5bb62b9854 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '.version_select at 0x7f2970ee1fc0>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:39 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-c55c435e-bc7d-46c1-aa87-7bf9b7c990c4 req-93269f36-e3ea-48af-94cd-f6847fe13678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66b5102-c56e-4209-afb2-c2594b271af6", "name": "network-vif-plugged", "status": "completed", "tag": "4b57e07f-f5a9-4524-9f4a-f97133808b99"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c55c435e-bc7d-46c1-aa87-7bf9b7c990c4 req-93269f36-e3ea-48af-94cd-f6847fe13678 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c55c435e-bc7d-46c1-aa87-7bf9b7c990c4 req-93269f36-e3ea-48af-94cd-f6847fe13678 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c55c435e-bc7d-46c1-aa87-7bf9b7c990c4 req-93269f36-e3ea-48af-94cd-f6847fe13678 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:39 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-c55c435e-bc7d-46c1-aa87-7bf9b7c990c4 req-93269f36-e3ea-48af-94cd-f6847fe13678 service nova] Creating event network-vif-plugged:4b57e07f-f5a9-4524-9f4a-f97133808b99 for instance c66b5102-c56e-4209-afb2-c2594b271af6 on user Apr 14 15:38:39 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-c55c435e-bc7d-46c1-aa87-7bf9b7c990c4 req-93269f36-e3ea-48af-94cd-f6847fe13678 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029658 Apr 14 15:38:39 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 50/154] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:39 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-ce0420f7-3e28-4d90-bfaa-2c5bb62b9854 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/images/c1382ef4-ea4d-4bc8-a660-6abf260444d7" status: 200 len: 1611 microversion: 2.1 time: 0.092359 Apr 14 15:38:39 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 51/155] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 15:38:39 2023] GET /compute/v2.1/images/c1382ef4-ea4d-4bc8-a660-6abf260444d7 => generated 1611 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:38:40 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-50897f4d-cf4c-4e13-bd4a-de7da953622a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:40 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-50897f4d-cf4c-4e13-bd4a-de7da953622a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-50897f4d-cf4c-4e13-bd4a-de7da953622a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-50897f4d-cf4c-4e13-bd4a-de7da953622a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-50897f4d-cf4c-4e13-bd4a-de7da953622a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-50897f4d-cf4c-4e13-bd4a-de7da953622a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:40 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b5c2de-9cb2-4bcc-a04a-a4924e51151c", "name": "network-vif-unplugged", "status": "completed", "tag": "7d184083-9af2-4aad-abc5-7d9c28804ee1"}, {"server_uuid": "40b5c2de-9cb2-4bcc-a04a-a4924e51151c", "name": "network-vif-plugged", "status": "completed", "tag": "7d184083-9af2-4aad-abc5-7d9c28804ee1"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-50897f4d-cf4c-4e13-bd4a-de7da953622a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-50897f4d-cf4c-4e13-bd4a-de7da953622a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:40 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] Creating event network-vif-unplugged:7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c on user Apr 14 15:38:40 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] Creating event network-vif-plugged:7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c on user Apr 14 15:38:40 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033246 Apr 14 15:38:40 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 51/156] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:40 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:40 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-50897f4d-cf4c-4e13-bd4a-de7da953622a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063d123ffa4f4695bcec3583831b6097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6fcd223054486a97d9cbc369eff77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:40 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-50897f4d-cf4c-4e13-bd4a-de7da953622a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063d123ffa4f4695bcec3583831b6097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6fcd223054486a97d9cbc369eff77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:40 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-50897f4d-cf4c-4e13-bd4a-de7da953622a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063d123ffa4f4695bcec3583831b6097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6fcd223054486a97d9cbc369eff77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:40 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-50897f4d-cf4c-4e13-bd4a-de7da953622a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa" status: 200 len: 2829 microversion: 2.42 time: 0.505350 Apr 14 15:38:40 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 55/157] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:38:39 2023] GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa => generated 2829 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:38:42 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-c2b444b8-7be2-4789-aa8f-2e0ade77d9a5 req-4191302a-28c2-486a-80c0-09cb0ae95d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b5c2de-9cb2-4bcc-a04a-a4924e51151c", "name": "network-vif-plugged", "status": "completed", "tag": "7d184083-9af2-4aad-abc5-7d9c28804ee1"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:42 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c8604237-aa3e-4868-a763-0898f9a46945 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:38:42 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-c8604237-aa3e-4868-a763-0898f9a46945 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:38:42 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c2b444b8-7be2-4789-aa8f-2e0ade77d9a5 req-4191302a-28c2-486a-80c0-09cb0ae95d50 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:42 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c2b444b8-7be2-4789-aa8f-2e0ade77d9a5 req-4191302a-28c2-486a-80c0-09cb0ae95d50 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:42 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c2b444b8-7be2-4789-aa8f-2e0ade77d9a5 req-4191302a-28c2-486a-80c0-09cb0ae95d50 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:42 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-c2b444b8-7be2-4789-aa8f-2e0ade77d9a5 req-4191302a-28c2-486a-80c0-09cb0ae95d50 service nova] Creating event network-vif-plugged:7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c on user Apr 14 15:38:42 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-c2b444b8-7be2-4789-aa8f-2e0ade77d9a5 req-4191302a-28c2-486a-80c0-09cb0ae95d50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038470 Apr 14 15:38:42 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 52/158] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:38:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c8604237-aa3e-4868-a763-0898f9a46945 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c8604237-aa3e-4868-a763-0898f9a46945 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c8604237-aa3e-4868-a763-0898f9a46945 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c8604237-aa3e-4868-a763-0898f9a46945 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c8604237-aa3e-4868-a763-0898f9a46945 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c8604237-aa3e-4868-a763-0898f9a46945 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:43 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-c8604237-aa3e-4868-a763-0898f9a46945 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16729d95f2742578646f5b33dedb48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140cbbc3a56d44eb99f7759080f26fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:43 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-c8604237-aa3e-4868-a763-0898f9a46945 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd16729d95f2742578646f5b33dedb48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140cbbc3a56d44eb99f7759080f26fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:43 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-c8604237-aa3e-4868-a763-0898f9a46945 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd16729d95f2742578646f5b33dedb48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140cbbc3a56d44eb99f7759080f26fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:38:43 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-c8604237-aa3e-4868-a763-0898f9a46945 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2" status: 200 len: 2822 microversion: 2.32 time: 0.566361 Apr 14 15:38:43 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 52/159] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:38:42 2023] GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2 => generated 2822 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:38:44 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-15bf71f0-a85d-48b7-aa93-9b2b0ac22b80 req-0a02569b-d021-478d-8406-f57e3d636619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b5c2de-9cb2-4bcc-a04a-a4924e51151c", "name": "network-vif-plugged", "status": "completed", "tag": "7d184083-9af2-4aad-abc5-7d9c28804ee1"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:38:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-15bf71f0-a85d-48b7-aa93-9b2b0ac22b80 req-0a02569b-d021-478d-8406-f57e3d636619 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:38:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-15bf71f0-a85d-48b7-aa93-9b2b0ac22b80 req-0a02569b-d021-478d-8406-f57e3d636619 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:38:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-15bf71f0-a85d-48b7-aa93-9b2b0ac22b80 req-0a02569b-d021-478d-8406-f57e3d636619 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:38:44 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-15bf71f0-a85d-48b7-aa93-9b2b0ac22b80 req-0a02569b-d021-478d-8406-f57e3d636619 service nova] Creating event network-vif-plugged:7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c on user Apr 14 15:38:44 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-15bf71f0-a85d-48b7-aa93-9b2b0ac22b80 req-0a02569b-d021-478d-8406-f57e3d636619 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035291 Apr 14 15:38:44 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 56/160] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:38:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:02 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:39:02 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:39:02 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-f511a474-bf93-40f5-8e85-2c3cda8561df tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:02 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-f511a474-bf93-40f5-8e85-2c3cda8561df tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f511a474-bf93-40f5-8e85-2c3cda8561df tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f511a474-bf93-40f5-8e85-2c3cda8561df tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f511a474-bf93-40f5-8e85-2c3cda8561df tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f511a474-bf93-40f5-8e85-2c3cda8561df tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f511a474-bf93-40f5-8e85-2c3cda8561df tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f511a474-bf93-40f5-8e85-2c3cda8561df tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:02 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-f511a474-bf93-40f5-8e85-2c3cda8561df tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.179946 Apr 14 15:39:02 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 53/161] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 15:39:02 2023] GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0/os-interface => generated 282 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:03 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f094302b-0730-4754-b9e9-ec203312b8c0", "tag": "674fa5df-38fc-4d44-9f38-fbae08c80e81"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:03 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=20 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:39:03 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:39:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:03 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] Creating event network-changed:674fa5df-38fc-4d44-9f38-fbae08c80e81 for instance f094302b-0730-4754-b9e9-ec203312b8c0 on user Apr 14 15:39:03 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042044 Apr 14 15:39:03 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 53/162] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:05 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=24 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:39:05 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:39:05 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1689ce6-7810-4426-9055-9784f48b7e62"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:05 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:06 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320384 Apr 14 15:39:06 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 57/163] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:39:05 2023] POST /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ef09deb7-8ddb-4b24-a3e8-9ffd3b25d0b2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:08 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ef09deb7-8ddb-4b24-a3e8-9ffd3b25d0b2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ef09deb7-8ddb-4b24-a3e8-9ffd3b25d0b2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ef09deb7-8ddb-4b24-a3e8-9ffd3b25d0b2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ef09deb7-8ddb-4b24-a3e8-9ffd3b25d0b2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ef09deb7-8ddb-4b24-a3e8-9ffd3b25d0b2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ef09deb7-8ddb-4b24-a3e8-9ffd3b25d0b2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ef09deb7-8ddb-4b24-a3e8-9ffd3b25d0b2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ef09deb7-8ddb-4b24-a3e8-9ffd3b25d0b2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.168713 Apr 14 15:39:08 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 54/164] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 15:39:08 2023] GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-interface => generated 282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:08 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6024e936-533f-45de-a53e-bddbc2ea174b tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:08 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-6024e936-533f-45de-a53e-bddbc2ea174b tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6024e936-533f-45de-a53e-bddbc2ea174b tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6024e936-533f-45de-a53e-bddbc2ea174b tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6024e936-533f-45de-a53e-bddbc2ea174b tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6024e936-533f-45de-a53e-bddbc2ea174b tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6024e936-533f-45de-a53e-bddbc2ea174b tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6024e936-533f-45de-a53e-bddbc2ea174b tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-6024e936-533f-45de-a53e-bddbc2ea174b tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.168236 Apr 14 15:39:09 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 54/165] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 15:39:08 2023] GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/os-interface => generated 282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:09 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b57881-e95e-41d5-9f78-61d95ecfd93a", "tag": "3bdad8ab-4716-4bb3-b21e-890e392b5430"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] Creating event network-changed:3bdad8ab-4716-4bb3-b21e-890e392b5430 for instance 31b57881-e95e-41d5-9f78-61d95ecfd93a on user Apr 14 15:39:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034078 Apr 14 15:39:09 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 58/166] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:09 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0050c51-18a0-48f3-9758-29d5adf738e1"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:09 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:09 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "POST /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296453 Apr 14 15:39:09 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 55/167] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:39:09 2023] POST /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:10 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3", "tag": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:10 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] Creating event network-changed:9cb5e2c1-d5d0-4325-8847-6e18b178afbf for instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 on user Apr 14 15:39:10 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035261 Apr 14 15:39:10 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 55/168] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:12 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-1adb1dcd-0c95-4388-9cf0-b8a3af5b250a tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:12 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-1adb1dcd-0c95-4388-9cf0-b8a3af5b250a tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1adb1dcd-0c95-4388-9cf0-b8a3af5b250a tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1adb1dcd-0c95-4388-9cf0-b8a3af5b250a tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1adb1dcd-0c95-4388-9cf0-b8a3af5b250a tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1adb1dcd-0c95-4388-9cf0-b8a3af5b250a tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1adb1dcd-0c95-4388-9cf0-b8a3af5b250a tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1adb1dcd-0c95-4388-9cf0-b8a3af5b250a tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:12 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-1adb1dcd-0c95-4388-9cf0-b8a3af5b250a tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.248006 Apr 14 15:39:12 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 59/169] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 15:39:12 2023] GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-interface => generated 283 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:39:13 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "112ffb8d-fef8-4ffd-991c-626c7e4c85b5", "tag": "1f6caa20-5ea5-475a-8060-25725837c3c5"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:13 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] Creating event network-changed:1f6caa20-5ea5-475a-8060-25725837c3c5 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 on user Apr 14 15:39:13 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038284 Apr 14 15:39:13 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 56/170] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:13 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3c38e8d7-302f-4790-a05a-0db50ecf5e32 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:13 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-3c38e8d7-302f-4790-a05a-0db50ecf5e32 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3c38e8d7-302f-4790-a05a-0db50ecf5e32 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3c38e8d7-302f-4790-a05a-0db50ecf5e32 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3c38e8d7-302f-4790-a05a-0db50ecf5e32 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3c38e8d7-302f-4790-a05a-0db50ecf5e32 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3c38e8d7-302f-4790-a05a-0db50ecf5e32 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3c38e8d7-302f-4790-a05a-0db50ecf5e32 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:13 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-3c38e8d7-302f-4790-a05a-0db50ecf5e32 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:13 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-3c38e8d7-302f-4790-a05a-0db50ecf5e32 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:13 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-3c38e8d7-302f-4790-a05a-0db50ecf5e32 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:13 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-3c38e8d7-302f-4790-a05a-0db50ecf5e32 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5" status: 200 len: 1628 microversion: 2.49 time: 0.406189 Apr 14 15:39:13 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 56/171] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:39:13 2023] GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5 => generated 1628 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:39:13 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "tag": "nic-tag"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:13 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:13 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5837355b-18c3-4f1c-b48a-8e9afa7eb964 tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5756fc28-3f52-41c9-92b5-f652ee2d13fc"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:13 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-5837355b-18c3-4f1c-b48a-8e9afa7eb964 tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5837355b-18c3-4f1c-b48a-8e9afa7eb964 tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5837355b-18c3-4f1c-b48a-8e9afa7eb964 tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5837355b-18c3-4f1c-b48a-8e9afa7eb964 tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5837355b-18c3-4f1c-b48a-8e9afa7eb964 tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5837355b-18c3-4f1c-b48a-8e9afa7eb964 tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5837355b-18c3-4f1c-b48a-8e9afa7eb964 tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:14 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-5837355b-18c3-4f1c-b48a-8e9afa7eb964 tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] HTTP exception thrown: Volume 5756fc28-3f52-41c9-92b5-f652ee2d13fc could not be found. Apr 14 15:39:14 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5837355b-18c3-4f1c-b48a-8e9afa7eb964 tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Request method failure captured: Apr 14 15:39:14 user devstack@n-api.service[61876]: request: PUT /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0/os-volume_attachments/d1689ce6-7810-4426-9055-9784f48b7e62 HTTP/1.1 Apr 14 15:39:14 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:39:14 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:39:14 user devstack@n-api.service[61876]: Connection: close Apr 14 15:39:14 user devstack@n-api.service[61876]: Content-Length: 74 Apr 14 15:39:14 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:39:14 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:39:14 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:39:14 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXMbnNAxkAt5a7gPxJpswiHJBMQ5Bsisn7StpCOTbTFJsiLYmIjF_2dX-kwBhcBx91XNHIXd3QA0NkqVDPY3Iaxm9UmShoxahn9oOI6TEwpCiZyTqMmA0uTMrwu84V3Fx6o7BQUaTpME_e_smgrEXU5R89JopjHiNzOqot8kk_GY1is Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Project-Id: d1554476c59048d28071b22216e4ed51 Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Project-Name: tempest-VolumesAdminNegativeTest-1236380103 Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Role: admin,reader,member Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Roles: admin,reader,member Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1554476c59048d28071b22216e4ed51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1554476c59048d28071b22216e4ed51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1554476c59048d28071b22216e4ed51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Tenant: tempest-VolumesAdminNegativeTest-1236380103 Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Tenant-Id: d1554476c59048d28071b22216e4ed51 Apr 14 15:39:14 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1236380103 Apr 14 15:39:14 user devstack@n-api.service[61876]: X-User: tempest-VolumesAdminNegativeTest-1236380103-project-admin Apr 14 15:39:14 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:39:14 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:39:14 user devstack@n-api.service[61876]: X-User-Id: 74e84e7c3b3b42eb9f08208bb474b0ad Apr 14 15:39:14 user devstack@n-api.service[61876]: X-User-Name: tempest-VolumesAdminNegativeTest-1236380103-project-admin Apr 14 15:39:14 user devstack@n-api.service[61876]: Apr 14 15:39:14 user devstack@n-api.service[61876]: {"volumeAttachment": {"volumeId": "5756fc28-3f52-41c9-92b5-f652ee2d13fc"}} Apr 14 15:39:14 user devstack@n-api.service[61876]: method: > Apr 14 15:39:14 user devstack@n-api.service[61876]: exception: Volume 5756fc28-3f52-41c9-92b5-f652ee2d13fc could not be found. Apr 14 15:39:14 user devstack@n-api.service[61876]: action_args: {'server_id': 'f094302b-0730-4754-b9e9-ec203312b8c0', 'id': 'd1689ce6-7810-4426-9055-9784f48b7e62', 'body': {'volumeAttachment': {'volumeId': '5756fc28-3f52-41c9-92b5-f652ee2d13fc'}}} Apr 14 15:39:14 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5756fc28-3f52-41c9-92b5-f652ee2d13fc could not be found. (HTTP 404) (Request-ID: req-2304fe55-5c9b-45ad-8e0e-cf3c7a6b5fcb) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5756fc28-3f52-41c9-92b5-f652ee2d13fc could not be found. Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 5756fc28-3f52-41c9-92b5-f652ee2d13fc could not be found. Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5756fc28-3f52-41c9-92b5-f652ee2d13fc could not be found. Apr 14 15:39:14 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:14 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5837355b-18c3-4f1c-b48a-8e9afa7eb964 tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Returning 400 to user: Volume 5756fc28-3f52-41c9-92b5-f652ee2d13fc could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:39:14 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5837355b-18c3-4f1c-b48a-8e9afa7eb964 tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0/os-volume_attachments/d1689ce6-7810-4426-9055-9784f48b7e62" status: 400 len: 107 microversion: 2.1 time: 0.358939 Apr 14 15:39:14 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 57/172] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 15:39:13 2023] PUT /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0/os-volume_attachments/d1689ce6-7810-4426-9055-9784f48b7e62 => generated 107 bytes in 360 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:39:14 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:14 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:14 user devstack@n-api.service[61875]: DEBUG nova.objects.instance [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lazy-loading 'services' on Instance uuid f094302b-0730-4754-b9e9-ec203312b8c0 {{(pid=61875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:39:14 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0/os-volume_attachments/d1689ce6-7810-4426-9055-9784f48b7e62" status: 202 len: 0 microversion: 2.1 time: 0.257899 Apr 14 15:39:14 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 57/173] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:39:14 2023] DELETE /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0/os-volume_attachments/d1689ce6-7810-4426-9055-9784f48b7e62 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:39:14 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-49116f84-4171-4d63-a846-1813075cf2d3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:14 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-49116f84-4171-4d63-a846-1813075cf2d3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-49116f84-4171-4d63-a846-1813075cf2d3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-49116f84-4171-4d63-a846-1813075cf2d3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-49116f84-4171-4d63-a846-1813075cf2d3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-49116f84-4171-4d63-a846-1813075cf2d3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-49116f84-4171-4d63-a846-1813075cf2d3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-49116f84-4171-4d63-a846-1813075cf2d3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:14 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-49116f84-4171-4d63-a846-1813075cf2d3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053329 Apr 14 15:39:14 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 58/174] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:39:14 2023] GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:15 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-24c1ba18-0b7a-4ad8-a8c2-d6dd7d73c016 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:15 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-24c1ba18-0b7a-4ad8-a8c2-d6dd7d73c016 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24c1ba18-0b7a-4ad8-a8c2-d6dd7d73c016 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24c1ba18-0b7a-4ad8-a8c2-d6dd7d73c016 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24c1ba18-0b7a-4ad8-a8c2-d6dd7d73c016 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24c1ba18-0b7a-4ad8-a8c2-d6dd7d73c016 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24c1ba18-0b7a-4ad8-a8c2-d6dd7d73c016 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24c1ba18-0b7a-4ad8-a8c2-d6dd7d73c016 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:15 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "112ffb8d-fef8-4ffd-991c-626c7e4c85b5", "tag": "13e7a077-9dd8-44e8-83d5-34706df407b6"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:15 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] Creating event network-changed:13e7a077-9dd8-44e8-83d5-34706df407b6 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 on user Apr 14 15:39:15 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035015 Apr 14 15:39:15 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 59/175] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:15 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-24c1ba18-0b7a-4ad8-a8c2-d6dd7d73c016 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af824b840c604223afd90bce17fe1ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e73ef2ad94e84876def53ddf43da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:15 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-24c1ba18-0b7a-4ad8-a8c2-d6dd7d73c016 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" status: 200 len: 1495 microversion: 2.1 time: 0.280151 Apr 14 15:39:15 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 58/176] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:39:15 2023] GET /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 => generated 1495 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:39:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9667742d-79e9-4d48-ba8c-b91316611c05"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:16 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-fea6e542-c172-4cf1-bf96-f1012066a6ab req-33c7887a-5c51-4d21-b57c-81f0dd2b146d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112ffb8d-fef8-4ffd-991c-626c7e4c85b5", "name": "network-vif-plugged", "status": "completed", "tag": "13e7a077-9dd8-44e8-83d5-34706df407b6"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fea6e542-c172-4cf1-bf96-f1012066a6ab req-33c7887a-5c51-4d21-b57c-81f0dd2b146d service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fea6e542-c172-4cf1-bf96-f1012066a6ab req-33c7887a-5c51-4d21-b57c-81f0dd2b146d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fea6e542-c172-4cf1-bf96-f1012066a6ab req-33c7887a-5c51-4d21-b57c-81f0dd2b146d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-fea6e542-c172-4cf1-bf96-f1012066a6ab req-33c7887a-5c51-4d21-b57c-81f0dd2b146d service nova] Creating event network-vif-plugged:13e7a077-9dd8-44e8-83d5-34706df407b6 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 on user Apr 14 15:39:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-fea6e542-c172-4cf1-bf96-f1012066a6ab req-33c7887a-5c51-4d21-b57c-81f0dd2b146d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048594 Apr 14 15:39:16 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 59/177] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:16 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:16 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "POST /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.319410 Apr 14 15:39:16 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 60/178] 10.0.0.210 () {66 vars in 1414 bytes} [Fri Apr 14 15:39:13 2023] POST /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-interface => generated 283 bytes in 3321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:39:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e94e1b3f-9e5e-4216-88c9-f9da41093684", "tag": "volume-tag"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:16 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:18 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.033616 Apr 14 15:39:18 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 60/179] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:39:16 2023] POST /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/os-volume_attachments => generated 194 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:18 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "POST /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 1.617345 Apr 14 15:39:18 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 60/180] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 15:39:16 2023] POST /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-volume_attachments => generated 194 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:39:18 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-3b0043a3-9fb7-427e-a113-0286f0b08194 req-deb86de2-70bc-450c-a8f3-7bda311b48a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112ffb8d-fef8-4ffd-991c-626c7e4c85b5", "name": "network-vif-plugged", "status": "completed", "tag": "13e7a077-9dd8-44e8-83d5-34706df407b6"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-3b0043a3-9fb7-427e-a113-0286f0b08194 req-deb86de2-70bc-450c-a8f3-7bda311b48a8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-3b0043a3-9fb7-427e-a113-0286f0b08194 req-deb86de2-70bc-450c-a8f3-7bda311b48a8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-3b0043a3-9fb7-427e-a113-0286f0b08194 req-deb86de2-70bc-450c-a8f3-7bda311b48a8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:18 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-3b0043a3-9fb7-427e-a113-0286f0b08194 req-deb86de2-70bc-450c-a8f3-7bda311b48a8 service nova] Creating event network-vif-plugged:13e7a077-9dd8-44e8-83d5-34706df407b6 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 on user Apr 14 15:39:18 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-3b0043a3-9fb7-427e-a113-0286f0b08194 req-deb86de2-70bc-450c-a8f3-7bda311b48a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037960 Apr 14 15:39:18 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 61/181] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:20 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6acb1716-36ab-49e5-b535-81bdf883a2a1"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:20 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:20 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments/b0050c51-18a0-48f3-9758-29d5adf738e1" status: 202 len: 0 microversion: 2.1 time: 0.471154 Apr 14 15:39:20 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 61/182] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 15:39:20 2023] PUT /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments/b0050c51-18a0-48f3-9758-29d5adf738e1 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:39:24 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bcdbc43d-6291-4a4e-b56f-5b80d8cdc01a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:24 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-bcdbc43d-6291-4a4e-b56f-5b80d8cdc01a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bcdbc43d-6291-4a4e-b56f-5b80d8cdc01a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bcdbc43d-6291-4a4e-b56f-5b80d8cdc01a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bcdbc43d-6291-4a4e-b56f-5b80d8cdc01a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bcdbc43d-6291-4a4e-b56f-5b80d8cdc01a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bcdbc43d-6291-4a4e-b56f-5b80d8cdc01a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bcdbc43d-6291-4a4e-b56f-5b80d8cdc01a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:24 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-bcdbc43d-6291-4a4e-b56f-5b80d8cdc01a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:24 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-bcdbc43d-6291-4a4e-b56f-5b80d8cdc01a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:24 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-bcdbc43d-6291-4a4e-b56f-5b80d8cdc01a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-bcdbc43d-6291-4a4e-b56f-5b80d8cdc01a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c" status: 200 len: 1690 microversion: 2.87 time: 0.240439 Apr 14 15:39:24 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 61/183] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:39:24 2023] GET /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c => generated 1690 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:39:26 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3fe04cd4-385e-4e3c-9a33-d3c6ad83683c tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:26 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-3fe04cd4-385e-4e3c-9a33-d3c6ad83683c tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3fe04cd4-385e-4e3c-9a33-d3c6ad83683c tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3fe04cd4-385e-4e3c-9a33-d3c6ad83683c tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3fe04cd4-385e-4e3c-9a33-d3c6ad83683c tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3fe04cd4-385e-4e3c-9a33-d3c6ad83683c tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3fe04cd4-385e-4e3c-9a33-d3c6ad83683c tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3fe04cd4-385e-4e3c-9a33-d3c6ad83683c tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:26 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-3fe04cd4-385e-4e3c-9a33-d3c6ad83683c tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] HTTP exception thrown: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:26 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3fe04cd4-385e-4e3c-9a33-d3c6ad83683c tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Request method failure captured: Apr 14 15:39:26 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6 HTTP/1.1 Apr 14 15:39:26 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:39:26 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:39:26 user devstack@n-api.service[61874]: Connection: close Apr 14 15:39:26 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:39:26 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:39:26 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:39:26 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:39:26 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXL7GwyKyl1Dr-eI-oTffvttounRL_J5kWrjCLnZr93yrIMwnjGsr4U3erio1erxP2AbiO11DPU3kJcL_2Err60gVX7nIuV12yRpjMgE1uz9cY2-I58IW4PT7OTmd7ao9gchLs80L8hw3kkd6dmXFRzH2aTzydyq1clU2i-w-YU7MHo Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Project-Id: ef8097227d514468b100a6a637bb6287 Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Project-Name: tempest-DeleteServersTestJSON-182432264 Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ef8097227d514468b100a6a637bb6287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef8097227d514468b100a6a637bb6287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef8097227d514468b100a6a637bb6287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Tenant: tempest-DeleteServersTestJSON-182432264 Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Tenant-Id: ef8097227d514468b100a6a637bb6287 Apr 14 15:39:26 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-DeleteServersTestJSON-182432264 Apr 14 15:39:26 user devstack@n-api.service[61874]: X-User: tempest-DeleteServersTestJSON-182432264-project-member Apr 14 15:39:26 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:39:26 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:39:26 user devstack@n-api.service[61874]: X-User-Id: 556b4bd256ee41398d5fd89ef2191550 Apr 14 15:39:26 user devstack@n-api.service[61874]: X-User-Name: tempest-DeleteServersTestJSON-182432264-project-member Apr 14 15:39:26 user devstack@n-api.service[61874]: method: > Apr 14 15:39:26 user devstack@n-api.service[61874]: exception: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:26 user devstack@n-api.service[61874]: action_args: {'id': 'c66b5102-c56e-4209-afb2-c2594b271af6'} Apr 14 15:39:26 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:26 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:39:26 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3fe04cd4-385e-4e3c-9a33-d3c6ad83683c tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Returning 404 to user: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:39:26 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-3fe04cd4-385e-4e3c-9a33-d3c6ad83683c tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6" status: 404 len: 111 microversion: 2.1 time: 0.033670 Apr 14 15:39:26 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 62/184] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:39:26 2023] GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:39:26 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6555a4c5-e1a3-4757-8709-7c4e1de8f548 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:26 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-6555a4c5-e1a3-4757-8709-7c4e1de8f548 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6555a4c5-e1a3-4757-8709-7c4e1de8f548 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6555a4c5-e1a3-4757-8709-7c4e1de8f548 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6555a4c5-e1a3-4757-8709-7c4e1de8f548 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6555a4c5-e1a3-4757-8709-7c4e1de8f548 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6555a4c5-e1a3-4757-8709-7c4e1de8f548 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6555a4c5-e1a3-4757-8709-7c4e1de8f548 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:26 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-6555a4c5-e1a3-4757-8709-7c4e1de8f548 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] HTTP exception thrown: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:27 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6555a4c5-e1a3-4757-8709-7c4e1de8f548 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Request method failure captured: Apr 14 15:39:27 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6/os-volume_attachments HTTP/1.1 Apr 14 15:39:27 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:39:27 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:39:27 user devstack@n-api.service[61876]: Connection: close Apr 14 15:39:27 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:39:27 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:39:27 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:39:27 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:39:27 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXL7GwyKyl1Dr-eI-oTffvttounRL_J5kWrjCLnZr93yrIMwnjGsr4U3erio1erxP2AbiO11DPU3kJcL_2Err60gVX7nIuV12yRpjMgE1uz9cY2-I58IW4PT7OTmd7ao9gchLs80L8hw3kkd6dmXFRzH2aTzydyq1clU2i-w-YU7MHo Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Project-Id: ef8097227d514468b100a6a637bb6287 Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Project-Name: tempest-DeleteServersTestJSON-182432264 Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ef8097227d514468b100a6a637bb6287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef8097227d514468b100a6a637bb6287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef8097227d514468b100a6a637bb6287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Tenant: tempest-DeleteServersTestJSON-182432264 Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Tenant-Id: ef8097227d514468b100a6a637bb6287 Apr 14 15:39:27 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-DeleteServersTestJSON-182432264 Apr 14 15:39:27 user devstack@n-api.service[61876]: X-User: tempest-DeleteServersTestJSON-182432264-project-member Apr 14 15:39:27 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:39:27 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:39:27 user devstack@n-api.service[61876]: X-User-Id: 556b4bd256ee41398d5fd89ef2191550 Apr 14 15:39:27 user devstack@n-api.service[61876]: X-User-Name: tempest-DeleteServersTestJSON-182432264-project-member Apr 14 15:39:27 user devstack@n-api.service[61876]: method: > Apr 14 15:39:27 user devstack@n-api.service[61876]: exception: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:27 user devstack@n-api.service[61876]: action_args: {'server_id': 'c66b5102-c56e-4209-afb2-c2594b271af6'} Apr 14 15:39:27 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:27 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:27 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6555a4c5-e1a3-4757-8709-7c4e1de8f548 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Returning 404 to user: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:39:27 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6555a4c5-e1a3-4757-8709-7c4e1de8f548 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044575 Apr 14 15:39:27 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 62/185] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:39:26 2023] GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:39:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-be45cb72-f724-420f-89e4-f02f55a746aa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:28 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-be45cb72-f724-420f-89e4-f02f55a746aa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-be45cb72-f724-420f-89e4-f02f55a746aa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-be45cb72-f724-420f-89e4-f02f55a746aa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-be45cb72-f724-420f-89e4-f02f55a746aa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-be45cb72-f724-420f-89e4-f02f55a746aa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-be45cb72-f724-420f-89e4-f02f55a746aa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-be45cb72-f724-420f-89e4-f02f55a746aa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:28 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-be45cb72-f724-420f-89e4-f02f55a746aa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-be45cb72-f724-420f-89e4-f02f55a746aa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c" status: 200 len: 1489 microversion: 2.1 time: 0.329213 Apr 14 15:39:28 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 62/186] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:39:28 2023] GET /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c => generated 1489 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:39:29 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-1a483beb-4045-4d38-a39a-11c14e89f5b8 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '.version_select at 0x7f2970c6e9e0>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:29 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-1a483beb-4045-4d38-a39a-11c14e89f5b8 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/images/c1382ef4-ea4d-4bc8-a660-6abf260444d7" status: 200 len: 1725 microversion: 2.1 time: 0.097348 Apr 14 15:39:29 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 63/187] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 15:39:29 2023] GET /compute/v2.1/images/c1382ef4-ea4d-4bc8-a660-6abf260444d7 => generated 1725 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:39:29 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-c2f011f1-9799-4429-aff3-825bacae003c tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '.version_select at 0x7f2970cc6c20>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:29 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-c2f011f1-9799-4429-aff3-825bacae003c tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/images/c1382ef4-ea4d-4bc8-a660-6abf260444d7" status: 200 len: 1725 microversion: 2.1 time: 0.078381 Apr 14 15:39:29 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 63/188] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 15:39:29 2023] GET /compute/v2.1/images/c1382ef4-ea4d-4bc8-a660-6abf260444d7 => generated 1725 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:39:29 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-0c4b45db-2afc-420a-be68-438508d92247 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:29 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-0c4b45db-2afc-420a-be68-438508d92247 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0c4b45db-2afc-420a-be68-438508d92247 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0c4b45db-2afc-420a-be68-438508d92247 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0c4b45db-2afc-420a-be68-438508d92247 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0c4b45db-2afc-420a-be68-438508d92247 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0c4b45db-2afc-420a-be68-438508d92247 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0c4b45db-2afc-420a-be68-438508d92247 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:29 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-0c4b45db-2afc-420a-be68-438508d92247 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f805db20d87d4429981c975ebd88ed92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8230c5386464f288fd783b3c60536b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:29 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-0c4b45db-2afc-420a-be68-438508d92247 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed" status: 200 len: 1669 microversion: 2.1 time: 0.405514 Apr 14 15:39:29 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 63/189] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:39:29 2023] GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed => generated 1669 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:39:30 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3ed88eef-ffff-4625-9277-b0c83c600f01 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:30 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-3ed88eef-ffff-4625-9277-b0c83c600f01 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3ed88eef-ffff-4625-9277-b0c83c600f01 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3ed88eef-ffff-4625-9277-b0c83c600f01 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3ed88eef-ffff-4625-9277-b0c83c600f01 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3ed88eef-ffff-4625-9277-b0c83c600f01 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3ed88eef-ffff-4625-9277-b0c83c600f01 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3ed88eef-ffff-4625-9277-b0c83c600f01 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-3ed88eef-ffff-4625-9277-b0c83c600f01 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063584 Apr 14 15:39:30 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 64/190] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:39:30 2023] GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:30 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:30 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:30 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lazy-loading 'services' on Instance uuid 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:39:30 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/os-volume_attachments/9667742d-79e9-4d48-ba8c-b91316611c05" status: 202 len: 0 microversion: 2.1 time: 0.304915 Apr 14 15:39:30 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 64/191] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:39:30 2023] DELETE /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/os-volume_attachments/9667742d-79e9-4d48-ba8c-b91316611c05 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:39:31 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:31 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:31 user devstack@n-api.service[61875]: DEBUG nova.objects.instance [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lazy-loading 'services' on Instance uuid 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=61875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:39:31 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-volume_attachments/e94e1b3f-9e5e-4216-88c9-f9da41093684" status: 202 len: 0 microversion: 2.49 time: 0.184925 Apr 14 15:39:31 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 64/192] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 15:39:31 2023] DELETE /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-volume_attachments/e94e1b3f-9e5e-4216-88c9-f9da41093684 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:39:32 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:32 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:32 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:39:32 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" status: 204 len: 0 microversion: 2.1 time: 0.156634 Apr 14 15:39:32 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 65/193] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:39:32 2023] DELETE /compute/v2.1/servers/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:39:32 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-704c61b1-0c1b-4b42-9855-7e0a2dea86af tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:32 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-704c61b1-0c1b-4b42-9855-7e0a2dea86af tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:32 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=23 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:39:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-704c61b1-0c1b-4b42-9855-7e0a2dea86af tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-704c61b1-0c1b-4b42-9855-7e0a2dea86af tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-704c61b1-0c1b-4b42-9855-7e0a2dea86af tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-704c61b1-0c1b-4b42-9855-7e0a2dea86af tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-704c61b1-0c1b-4b42-9855-7e0a2dea86af tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-704c61b1-0c1b-4b42-9855-7e0a2dea86af tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:32 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:39:32 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-704c61b1-0c1b-4b42-9855-7e0a2dea86af tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426c9fdcd462435293f2208229c11458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c377cd3ce1454ed5a6257138350802f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:32 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-704c61b1-0c1b-4b42-9855-7e0a2dea86af tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" status: 200 len: 1491 microversion: 2.1 time: 0.266006 Apr 14 15:39:32 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 65/194] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:39:32 2023] GET /compute/v2.1/servers/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc => generated 1491 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:39:32 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-05913528-8b51-4c7a-8ce9-f6bad532a750 req-c58febdd-fb24-4987-9d61-b21489a8886f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc", "name": "network-vif-unplugged", "status": "completed", "tag": "e0c2ac1a-629d-4583-af53-a2fa5045c311"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-05913528-8b51-4c7a-8ce9-f6bad532a750 req-c58febdd-fb24-4987-9d61-b21489a8886f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-05913528-8b51-4c7a-8ce9-f6bad532a750 req-c58febdd-fb24-4987-9d61-b21489a8886f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-05913528-8b51-4c7a-8ce9-f6bad532a750 req-c58febdd-fb24-4987-9d61-b21489a8886f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-05913528-8b51-4c7a-8ce9-f6bad532a750 req-c58febdd-fb24-4987-9d61-b21489a8886f service nova] Creating event network-vif-unplugged:e0c2ac1a-629d-4583-af53-a2fa5045c311 for instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc on user Apr 14 15:39:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-05913528-8b51-4c7a-8ce9-f6bad532a750 req-c58febdd-fb24-4987-9d61-b21489a8886f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047873 Apr 14 15:39:32 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 65/195] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:33 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-b1be9555-a00a-4936-bba7-d185ae83ceaa tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:33 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-b1be9555-a00a-4936-bba7-d185ae83ceaa tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b1be9555-a00a-4936-bba7-d185ae83ceaa tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b1be9555-a00a-4936-bba7-d185ae83ceaa tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b1be9555-a00a-4936-bba7-d185ae83ceaa tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b1be9555-a00a-4936-bba7-d185ae83ceaa tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b1be9555-a00a-4936-bba7-d185ae83ceaa tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b1be9555-a00a-4936-bba7-d185ae83ceaa tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:33 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-b1be9555-a00a-4936-bba7-d185ae83ceaa tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052630 Apr 14 15:39:33 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 66/196] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:39:33 2023] GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:33 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-810fc86a-4c04-4676-90a6-58000e9924bb tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:33 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-810fc86a-4c04-4676-90a6-58000e9924bb tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-810fc86a-4c04-4676-90a6-58000e9924bb tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-810fc86a-4c04-4676-90a6-58000e9924bb tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-810fc86a-4c04-4676-90a6-58000e9924bb tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-810fc86a-4c04-4676-90a6-58000e9924bb tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-810fc86a-4c04-4676-90a6-58000e9924bb tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-810fc86a-4c04-4676-90a6-58000e9924bb tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:33 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-810fc86a-4c04-4676-90a6-58000e9924bb tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052365 Apr 14 15:39:33 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:39:33 2023] GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:33 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b0050c51-18a0-48f3-9758-29d5adf738e1"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:33 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:33 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=29 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:39:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:33 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:39:34 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments/6acb1716-36ab-49e5-b535-81bdf883a2a1" status: 202 len: 0 microversion: 2.1 time: 0.407690 Apr 14 15:39:34 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 66/198] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 15:39:33 2023] PUT /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments/6acb1716-36ab-49e5-b535-81bdf883a2a1 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-ffdf7560-8a08-47e3-a976-1c15e8ea09c9 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-ffdf7560-8a08-47e3-a976-1c15e8ea09c9 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ffdf7560-8a08-47e3-a976-1c15e8ea09c9 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ffdf7560-8a08-47e3-a976-1c15e8ea09c9 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ffdf7560-8a08-47e3-a976-1c15e8ea09c9 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ffdf7560-8a08-47e3-a976-1c15e8ea09c9 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ffdf7560-8a08-47e3-a976-1c15e8ea09c9 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ffdf7560-8a08-47e3-a976-1c15e8ea09c9 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-ffdf7560-8a08-47e3-a976-1c15e8ea09c9 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044761 Apr 14 15:39:34 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 67/199] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:39:34 2023] GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c59d7dae-c73b-4a66-8a07-6d5ff6a17a04 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-c59d7dae-c73b-4a66-8a07-6d5ff6a17a04 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-interface/13e7a077-9dd8-44e8-83d5-34706df407b6" status: 202 len: 0 microversion: 2.49 time: 0.047658 Apr 14 15:39:34 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 67/200] 10.0.0.210 () {64 vars in 1507 bytes} [Fri Apr 14 15:39:34 2023] DELETE /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-interface/13e7a077-9dd8-44e8-83d5-34706df407b6 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c59d7dae-c73b-4a66-8a07-6d5ff6a17a04 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c59d7dae-c73b-4a66-8a07-6d5ff6a17a04 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c59d7dae-c73b-4a66-8a07-6d5ff6a17a04 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c59d7dae-c73b-4a66-8a07-6d5ff6a17a04 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c59d7dae-c73b-4a66-8a07-6d5ff6a17a04 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c59d7dae-c73b-4a66-8a07-6d5ff6a17a04 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:34 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-c59d7dae-c73b-4a66-8a07-6d5ff6a17a04 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050810 Apr 14 15:39:34 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 67/201] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:39:34 2023] GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Going to try to terminate instance {{(pid=61876) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-82825a64-37cc-4c64-955e-eefe78273f53 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-82825a64-37cc-4c64-955e-eefe78273f53 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-82825a64-37cc-4c64-955e-eefe78273f53 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-82825a64-37cc-4c64-955e-eefe78273f53 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-82825a64-37cc-4c64-955e-eefe78273f53 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-82825a64-37cc-4c64-955e-eefe78273f53 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-82825a64-37cc-4c64-955e-eefe78273f53 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-82825a64-37cc-4c64-955e-eefe78273f53 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" status: 204 len: 0 microversion: 2.1 time: 0.226332 Apr 14 15:39:34 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 68/202] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:39:34 2023] DELETE /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a92ba726-738a-4e56-8b44-e376ae1830ed tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a92ba726-738a-4e56-8b44-e376ae1830ed tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a92ba726-738a-4e56-8b44-e376ae1830ed tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a92ba726-738a-4e56-8b44-e376ae1830ed tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a92ba726-738a-4e56-8b44-e376ae1830ed tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a92ba726-738a-4e56-8b44-e376ae1830ed tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a92ba726-738a-4e56-8b44-e376ae1830ed tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a92ba726-738a-4e56-8b44-e376ae1830ed tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-82825a64-37cc-4c64-955e-eefe78273f53 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-instance-actions/req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4" status: 200 len: 474 microversion: 2.49 time: 0.389994 Apr 14 15:39:34 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 68/203] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 15:39:34 2023] GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-instance-actions/req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 => generated 474 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc", "name": "network-vif-plugged", "status": "completed", "tag": "e0c2ac1a-629d-4583-af53-a2fa5045c311"}, {"server_uuid": "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc", "name": "network-vif-deleted", "tag": "e0c2ac1a-629d-4583-af53-a2fa5045c311"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] Creating event network-vif-plugged:e0c2ac1a-629d-4583-af53-a2fa5045c311 for instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc on user Apr 14 15:39:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] Creating event network-vif-deleted:e0c2ac1a-629d-4583-af53-a2fa5045c311 for instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc on user Apr 14 15:39:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063304 Apr 14 15:39:34 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 69/204] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:35 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-a92ba726-738a-4e56-8b44-e376ae1830ed tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4611274a77c4f3a8333771568ce9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02da33469a7a477b876331e9b846b99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:35 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-06e77149-d6f4-40f2-a816-1c9b2a3e154d req-1e59ec2c-16f3-4693-9b7a-bf9a4ca80c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112ffb8d-fef8-4ffd-991c-626c7e4c85b5", "name": "network-vif-unplugged", "status": "completed", "tag": "13e7a077-9dd8-44e8-83d5-34706df407b6"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-06e77149-d6f4-40f2-a816-1c9b2a3e154d req-1e59ec2c-16f3-4693-9b7a-bf9a4ca80c62 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-06e77149-d6f4-40f2-a816-1c9b2a3e154d req-1e59ec2c-16f3-4693-9b7a-bf9a4ca80c62 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-06e77149-d6f4-40f2-a816-1c9b2a3e154d req-1e59ec2c-16f3-4693-9b7a-bf9a4ca80c62 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a92ba726-738a-4e56-8b44-e376ae1830ed tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" status: 200 len: 1672 microversion: 2.1 time: 0.538416 Apr 14 15:39:35 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 68/205] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:39:34 2023] GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 => generated 1672 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:39:35 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-06e77149-d6f4-40f2-a816-1c9b2a3e154d req-1e59ec2c-16f3-4693-9b7a-bf9a4ca80c62 service nova] Creating event network-vif-unplugged:13e7a077-9dd8-44e8-83d5-34706df407b6 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 on user Apr 14 15:39:35 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-06e77149-d6f4-40f2-a816-1c9b2a3e154d req-1e59ec2c-16f3-4693-9b7a-bf9a4ca80c62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049246 Apr 14 15:39:35 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 69/206] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:39:36 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6344da34-2cb4-4185-93d7-16b1229c482f tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:36 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-6344da34-2cb4-4185-93d7-16b1229c482f tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6344da34-2cb4-4185-93d7-16b1229c482f tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6344da34-2cb4-4185-93d7-16b1229c482f tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6344da34-2cb4-4185-93d7-16b1229c482f tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6344da34-2cb4-4185-93d7-16b1229c482f tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6344da34-2cb4-4185-93d7-16b1229c482f tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6344da34-2cb4-4185-93d7-16b1229c482f tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:36 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-6344da34-2cb4-4185-93d7-16b1229c482f tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] HTTP exception thrown: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:36 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6344da34-2cb4-4185-93d7-16b1229c482f tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Request method failure captured: Apr 14 15:39:36 user devstack@n-api.service[61876]: request: DELETE /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6 HTTP/1.1 Apr 14 15:39:36 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:39:36 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:39:36 user devstack@n-api.service[61876]: Connection: close Apr 14 15:39:36 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:39:36 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:39:36 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:39:36 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:39:36 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXL7GwyKyl1Dr-eI-oTffvttounRL_J5kWrjCLnZr93yrIMwnjGsr4U3erio1erxP2AbiO11DPU3kJcL_2Err60gVX7nIuV12yRpjMgE1uz9cY2-I58IW4PT7OTmd7ao9gchLs80L8hw3kkd6dmXFRzH2aTzydyq1clU2i-w-YU7MHo Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Project-Id: ef8097227d514468b100a6a637bb6287 Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Project-Name: tempest-DeleteServersTestJSON-182432264 Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ef8097227d514468b100a6a637bb6287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef8097227d514468b100a6a637bb6287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef8097227d514468b100a6a637bb6287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Tenant: tempest-DeleteServersTestJSON-182432264 Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Tenant-Id: ef8097227d514468b100a6a637bb6287 Apr 14 15:39:36 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-DeleteServersTestJSON-182432264 Apr 14 15:39:36 user devstack@n-api.service[61876]: X-User: tempest-DeleteServersTestJSON-182432264-project-member Apr 14 15:39:36 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:39:36 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:39:36 user devstack@n-api.service[61876]: X-User-Id: 556b4bd256ee41398d5fd89ef2191550 Apr 14 15:39:36 user devstack@n-api.service[61876]: X-User-Name: tempest-DeleteServersTestJSON-182432264-project-member Apr 14 15:39:36 user devstack@n-api.service[61876]: method: > Apr 14 15:39:36 user devstack@n-api.service[61876]: exception: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:36 user devstack@n-api.service[61876]: action_args: {'id': 'c66b5102-c56e-4209-afb2-c2594b271af6'} Apr 14 15:39:36 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:36 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:39:36 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6344da34-2cb4-4185-93d7-16b1229c482f tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Returning 404 to user: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:39:36 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6344da34-2cb4-4185-93d7-16b1229c482f tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6" status: 404 len: 111 microversion: 2.1 time: 0.050091 Apr 14 15:39:36 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 70/207] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:39:36 2023] DELETE /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:39:36 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-dacf2afa-f437-4fd8-b4ce-5746c5fc86b0 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:36 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-dacf2afa-f437-4fd8-b4ce-5746c5fc86b0 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:36 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3", "name": "network-vif-unplugged", "status": "completed", "tag": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf"}, {"server_uuid": "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3", "name": "network-vif-plugged", "status": "completed", "tag": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf"}, {"server_uuid": "112ffb8d-fef8-4ffd-991c-626c7e4c85b5", "name": "network-vif-deleted", "tag": "13e7a077-9dd8-44e8-83d5-34706df407b6"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:36 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:39:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dacf2afa-f437-4fd8-b4ce-5746c5fc86b0 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dacf2afa-f437-4fd8-b4ce-5746c5fc86b0 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dacf2afa-f437-4fd8-b4ce-5746c5fc86b0 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dacf2afa-f437-4fd8-b4ce-5746c5fc86b0 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dacf2afa-f437-4fd8-b4ce-5746c5fc86b0 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dacf2afa-f437-4fd8-b4ce-5746c5fc86b0 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:36 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:39:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-dacf2afa-f437-4fd8-b4ce-5746c5fc86b0 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] HTTP exception thrown: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:36 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-dacf2afa-f437-4fd8-b4ce-5746c5fc86b0 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Request method failure captured: Apr 14 15:39:36 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6 HTTP/1.1 Apr 14 15:39:36 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:39:36 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:39:36 user devstack@n-api.service[61875]: Connection: close Apr 14 15:39:36 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:39:36 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:39:36 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:39:36 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:39:36 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXL7GwyKyl1Dr-eI-oTffvttounRL_J5kWrjCLnZr93yrIMwnjGsr4U3erio1erxP2AbiO11DPU3kJcL_2Err60gVX7nIuV12yRpjMgE1uz9cY2-I58IW4PT7OTmd7ao9gchLs80L8hw3kkd6dmXFRzH2aTzydyq1clU2i-w-YU7MHo Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Project-Id: ef8097227d514468b100a6a637bb6287 Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Project-Name: tempest-DeleteServersTestJSON-182432264 Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ef8097227d514468b100a6a637bb6287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef8097227d514468b100a6a637bb6287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef8097227d514468b100a6a637bb6287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Tenant: tempest-DeleteServersTestJSON-182432264 Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Tenant-Id: ef8097227d514468b100a6a637bb6287 Apr 14 15:39:36 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-DeleteServersTestJSON-182432264 Apr 14 15:39:36 user devstack@n-api.service[61875]: X-User: tempest-DeleteServersTestJSON-182432264-project-member Apr 14 15:39:36 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:39:36 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:39:36 user devstack@n-api.service[61875]: X-User-Id: 556b4bd256ee41398d5fd89ef2191550 Apr 14 15:39:36 user devstack@n-api.service[61875]: X-User-Name: tempest-DeleteServersTestJSON-182432264-project-member Apr 14 15:39:36 user devstack@n-api.service[61875]: method: > Apr 14 15:39:36 user devstack@n-api.service[61875]: exception: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:36 user devstack@n-api.service[61875]: action_args: {'id': 'c66b5102-c56e-4209-afb2-c2594b271af6'} Apr 14 15:39:36 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:39:36 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:39:37 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:39:37 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:39:37 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:39:37 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. Apr 14 15:39:37 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:39:37 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-dacf2afa-f437-4fd8-b4ce-5746c5fc86b0 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Returning 404 to user: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:39:37 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-dacf2afa-f437-4fd8-b4ce-5746c5fc86b0 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6" status: 404 len: 111 microversion: 2.1 time: 0.071574 Apr 14 15:39:37 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 69/208] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:39:36 2023] GET /compute/v2.1/servers/c66b5102-c56e-4209-afb2-c2594b271af6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:39:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Creating event network-vif-unplugged:9cb5e2c1-d5d0-4325-8847-6e18b178afbf for instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 on user Apr 14 15:39:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Creating event network-vif-plugged:9cb5e2c1-d5d0-4325-8847-6e18b178afbf for instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 on user Apr 14 15:39:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Creating event network-vif-deleted:13e7a077-9dd8-44e8-83d5-34706df407b6 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 on user Apr 14 15:39:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.083567 Apr 14 15:39:37 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 70/209] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:36 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:39:37 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-368ef4b2-1d28-415e-ade6-74d73a72aa58 req-aaa6522a-d20c-4895-8220-75cdc34d2e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112ffb8d-fef8-4ffd-991c-626c7e4c85b5", "name": "network-vif-plugged", "status": "completed", "tag": "13e7a077-9dd8-44e8-83d5-34706df407b6"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-368ef4b2-1d28-415e-ade6-74d73a72aa58 req-aaa6522a-d20c-4895-8220-75cdc34d2e08 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-368ef4b2-1d28-415e-ade6-74d73a72aa58 req-aaa6522a-d20c-4895-8220-75cdc34d2e08 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-368ef4b2-1d28-415e-ade6-74d73a72aa58 req-aaa6522a-d20c-4895-8220-75cdc34d2e08 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:37 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-368ef4b2-1d28-415e-ade6-74d73a72aa58 req-aaa6522a-d20c-4895-8220-75cdc34d2e08 service nova] Creating event network-vif-plugged:13e7a077-9dd8-44e8-83d5-34706df407b6 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 on user Apr 14 15:39:37 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-368ef4b2-1d28-415e-ade6-74d73a72aa58 req-aaa6522a-d20c-4895-8220-75cdc34d2e08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031751 Apr 14 15:39:37 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 71/210] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:39 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-cef580c1-6f7d-49ae-8659-e4ae53fa92f5 req-69e669de-47aa-44f1-91f8-1bb271a21a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3", "name": "network-vif-deleted", "tag": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-cef580c1-6f7d-49ae-8659-e4ae53fa92f5 req-69e669de-47aa-44f1-91f8-1bb271a21a18 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-cef580c1-6f7d-49ae-8659-e4ae53fa92f5 req-69e669de-47aa-44f1-91f8-1bb271a21a18 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-cef580c1-6f7d-49ae-8659-e4ae53fa92f5 req-69e669de-47aa-44f1-91f8-1bb271a21a18 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:39 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-cef580c1-6f7d-49ae-8659-e4ae53fa92f5 req-69e669de-47aa-44f1-91f8-1bb271a21a18 service nova] Creating event network-vif-deleted:9cb5e2c1-d5d0-4325-8847-6e18b178afbf for instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 on user Apr 14 15:39:39 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-cef580c1-6f7d-49ae-8659-e4ae53fa92f5 req-69e669de-47aa-44f1-91f8-1bb271a21a18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040808 Apr 14 15:39:39 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 70/211] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:40 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-38f269ed-5e23-4406-961a-41e87b80b4d4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:40 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-38f269ed-5e23-4406-961a-41e87b80b4d4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-38f269ed-5e23-4406-961a-41e87b80b4d4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-38f269ed-5e23-4406-961a-41e87b80b4d4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-38f269ed-5e23-4406-961a-41e87b80b4d4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-38f269ed-5e23-4406-961a-41e87b80b4d4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-38f269ed-5e23-4406-961a-41e87b80b4d4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-38f269ed-5e23-4406-961a-41e87b80b4d4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-38f269ed-5e23-4406-961a-41e87b80b4d4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa/os-interface" status: 200 len: 1827 microversion: 2.42 time: 0.970027 Apr 14 15:39:41 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 71/212] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 15:39:40 2023] GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa/os-interface => generated 1827 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 15:39:42 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "tag": "a5007998-31ee-4618-9fde-ab538bbd8e76"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:42 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:42 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:42 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:42 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] Creating event network-changed:a5007998-31ee-4618-9fde-ab538bbd8e76 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:42 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036869 Apr 14 15:39:42 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 72/213] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:39:42 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-ace14abb-2f27-422e-a3ea-65e036e84a10 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:42 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-ace14abb-2f27-422e-a3ea-65e036e84a10 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ace14abb-2f27-422e-a3ea-65e036e84a10 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ace14abb-2f27-422e-a3ea-65e036e84a10 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ace14abb-2f27-422e-a3ea-65e036e84a10 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ace14abb-2f27-422e-a3ea-65e036e84a10 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ace14abb-2f27-422e-a3ea-65e036e84a10 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ace14abb-2f27-422e-a3ea-65e036e84a10 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:43 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-ace14abb-2f27-422e-a3ea-65e036e84a10 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063d123ffa4f4695bcec3583831b6097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6fcd223054486a97d9cbc369eff77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:43 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-ace14abb-2f27-422e-a3ea-65e036e84a10 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063d123ffa4f4695bcec3583831b6097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6fcd223054486a97d9cbc369eff77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:43 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-ace14abb-2f27-422e-a3ea-65e036e84a10 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063d123ffa4f4695bcec3583831b6097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6fcd223054486a97d9cbc369eff77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:43 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-ace14abb-2f27-422e-a3ea-65e036e84a10 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa" status: 200 len: 2829 microversion: 2.42 time: 0.897923 Apr 14 15:39:43 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 71/214] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:39:42 2023] GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa => generated 2829 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:39:43 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-340ba9ce-6257-43cf-844b-29159f17edee tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:43 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-340ba9ce-6257-43cf-844b-29159f17edee tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-340ba9ce-6257-43cf-844b-29159f17edee tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-340ba9ce-6257-43cf-844b-29159f17edee tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-340ba9ce-6257-43cf-844b-29159f17edee tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-340ba9ce-6257-43cf-844b-29159f17edee tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-340ba9ce-6257-43cf-844b-29159f17edee tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-340ba9ce-6257-43cf-844b-29159f17edee tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:43 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-fe33d32a-de6d-4756-ae48-db7d557155b4 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:43 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-fe33d32a-de6d-4756-ae48-db7d557155b4 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fe33d32a-de6d-4756-ae48-db7d557155b4 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fe33d32a-de6d-4756-ae48-db7d557155b4 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fe33d32a-de6d-4756-ae48-db7d557155b4 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fe33d32a-de6d-4756-ae48-db7d557155b4 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fe33d32a-de6d-4756-ae48-db7d557155b4 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fe33d32a-de6d-4756-ae48-db7d557155b4 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:43 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-340ba9ce-6257-43cf-844b-29159f17edee tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa/os-interface" status: 200 len: 1827 microversion: 2.42 time: 0.126808 Apr 14 15:39:43 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 72/215] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 15:39:43 2023] GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa/os-interface => generated 1827 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:39:44 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-fe33d32a-de6d-4756-ae48-db7d557155b4 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.488770 Apr 14 15:39:44 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 73/216] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 15:39:43 2023] GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2/os-interface => generated 1829 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:39:44 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:44 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:44 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "tag": "ee1af132-bea9-465f-8b76-264c96b3f02b"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:44 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] Creating event network-changed:ee1af132-bea9-465f-8b76-264c96b3f02b for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:44 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042235 Apr 14 15:39:44 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 73/217] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-b2c87272-d290-4965-9063-47a73f435096 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-b2c87272-d290-4965-9063-47a73f435096 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:45 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b2c87272-d290-4965-9063-47a73f435096 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b2c87272-d290-4965-9063-47a73f435096 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b2c87272-d290-4965-9063-47a73f435096 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b2c87272-d290-4965-9063-47a73f435096 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b2c87272-d290-4965-9063-47a73f435096 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b2c87272-d290-4965-9063-47a73f435096 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:45 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa" status: 204 len: 0 microversion: 2.42 time: 0.272675 Apr 14 15:39:45 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 72/218] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 15:39:44 2023] DELETE /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 15:39:45 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-7bdeaf52-2c19-4b91-970d-78a5c5bd92b4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:45 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-7bdeaf52-2c19-4b91-970d-78a5c5bd92b4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7bdeaf52-2c19-4b91-970d-78a5c5bd92b4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7bdeaf52-2c19-4b91-970d-78a5c5bd92b4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7bdeaf52-2c19-4b91-970d-78a5c5bd92b4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7bdeaf52-2c19-4b91-970d-78a5c5bd92b4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7bdeaf52-2c19-4b91-970d-78a5c5bd92b4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7bdeaf52-2c19-4b91-970d-78a5c5bd92b4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-b2c87272-d290-4965-9063-47a73f435096 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16729d95f2742578646f5b33dedb48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140cbbc3a56d44eb99f7759080f26fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-b2c87272-d290-4965-9063-47a73f435096 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd16729d95f2742578646f5b33dedb48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140cbbc3a56d44eb99f7759080f26fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-b2c87272-d290-4965-9063-47a73f435096 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd16729d95f2742578646f5b33dedb48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140cbbc3a56d44eb99f7759080f26fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:45 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-b2c87272-d290-4965-9063-47a73f435096 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2" status: 200 len: 2822 microversion: 2.32 time: 0.372204 Apr 14 15:39:45 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 74/219] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:39:45 2023] GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2 => generated 2822 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:39:45 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c4fee8fb-0846-4d82-be8d-e8ca9e71c2d7 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:45 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-c4fee8fb-0846-4d82-be8d-e8ca9e71c2d7 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c4fee8fb-0846-4d82-be8d-e8ca9e71c2d7 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c4fee8fb-0846-4d82-be8d-e8ca9e71c2d7 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c4fee8fb-0846-4d82-be8d-e8ca9e71c2d7 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c4fee8fb-0846-4d82-be8d-e8ca9e71c2d7 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c4fee8fb-0846-4d82-be8d-e8ca9e71c2d7 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c4fee8fb-0846-4d82-be8d-e8ca9e71c2d7 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:45 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-7bdeaf52-2c19-4b91-970d-78a5c5bd92b4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063d123ffa4f4695bcec3583831b6097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6fcd223054486a97d9cbc369eff77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:45 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-7bdeaf52-2c19-4b91-970d-78a5c5bd92b4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063d123ffa4f4695bcec3583831b6097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6fcd223054486a97d9cbc369eff77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:45 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-7bdeaf52-2c19-4b91-970d-78a5c5bd92b4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063d123ffa4f4695bcec3583831b6097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6fcd223054486a97d9cbc369eff77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:45 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-7bdeaf52-2c19-4b91-970d-78a5c5bd92b4 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa" status: 200 len: 2954 microversion: 2.42 time: 0.397825 Apr 14 15:39:45 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 74/220] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:39:45 2023] GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa => generated 2954 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:39:45 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-c4fee8fb-0846-4d82-be8d-e8ca9e71c2d7 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.229900 Apr 14 15:39:45 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 73/221] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 15:39:45 2023] GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2/os-interface => generated 1829 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-d3277137-9fda-428e-9eb8-08940985132d req-8f9cecfc-51f6-4bfe-8b0b-2f3588c2744c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-unplugged", "status": "completed", "tag": "6a76a230-e352-46c5-bec1-7d283ac41b19"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d3277137-9fda-428e-9eb8-08940985132d req-8f9cecfc-51f6-4bfe-8b0b-2f3588c2744c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d3277137-9fda-428e-9eb8-08940985132d req-8f9cecfc-51f6-4bfe-8b0b-2f3588c2744c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d3277137-9fda-428e-9eb8-08940985132d req-8f9cecfc-51f6-4bfe-8b0b-2f3588c2744c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:45 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d3277137-9fda-428e-9eb8-08940985132d req-8f9cecfc-51f6-4bfe-8b0b-2f3588c2744c service nova] Creating event network-vif-unplugged:6a76a230-e352-46c5-bec1-7d283ac41b19 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:45 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-d3277137-9fda-428e-9eb8-08940985132d req-8f9cecfc-51f6-4bfe-8b0b-2f3588c2744c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070237 Apr 14 15:39:45 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 75/222] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:46 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-ee3444c8-363d-408a-bd52-5066713aaf68 req-5d0fe19d-6e1e-4a92-9b7c-aa18d5d17701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-unplugged", "status": "completed", "tag": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ee3444c8-363d-408a-bd52-5066713aaf68 req-5d0fe19d-6e1e-4a92-9b7c-aa18d5d17701 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ee3444c8-363d-408a-bd52-5066713aaf68 req-5d0fe19d-6e1e-4a92-9b7c-aa18d5d17701 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ee3444c8-363d-408a-bd52-5066713aaf68 req-5d0fe19d-6e1e-4a92-9b7c-aa18d5d17701 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:46 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-ee3444c8-363d-408a-bd52-5066713aaf68 req-5d0fe19d-6e1e-4a92-9b7c-aa18d5d17701 service nova] Creating event network-vif-unplugged:67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:46 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-ee3444c8-363d-408a-bd52-5066713aaf68 req-5d0fe19d-6e1e-4a92-9b7c-aa18d5d17701 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052302 Apr 14 15:39:46 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 75/223] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:47 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-unplugged", "status": "completed", "tag": "a5007998-31ee-4618-9fde-ab538bbd8e76"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "a5007998-31ee-4618-9fde-ab538bbd8e76"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-unplugged", "status": "completed", "tag": "e2de16b7-a60f-4fba-ace4-21ab648d036e"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "e2de16b7-a60f-4fba-ace4-21ab648d036e"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:47 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Creating event network-vif-unplugged:a5007998-31ee-4618-9fde-ab538bbd8e76 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:47 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Creating event network-vif-plugged:a5007998-31ee-4618-9fde-ab538bbd8e76 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:47 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Creating event network-vif-unplugged:e2de16b7-a60f-4fba-ace4-21ab648d036e for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:47 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Creating event network-vif-plugged:e2de16b7-a60f-4fba-ace4-21ab648d036e for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:47 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.090064 Apr 14 15:39:47 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 74/224] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:46 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:47 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:47 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:47 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Going to try to terminate instance {{(pid=61876) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:39:47 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2" status: 204 len: 0 microversion: 2.32 time: 0.223902 Apr 14 15:39:47 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 76/225] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 15:39:47 2023] DELETE /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 15:39:47 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-6caf6f7b-bcd1-4fe9-bd69-ac3a66e1e687 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:47 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-6caf6f7b-bcd1-4fe9-bd69-ac3a66e1e687 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6caf6f7b-bcd1-4fe9-bd69-ac3a66e1e687 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6caf6f7b-bcd1-4fe9-bd69-ac3a66e1e687 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6caf6f7b-bcd1-4fe9-bd69-ac3a66e1e687 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6caf6f7b-bcd1-4fe9-bd69-ac3a66e1e687 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6caf6f7b-bcd1-4fe9-bd69-ac3a66e1e687 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6caf6f7b-bcd1-4fe9-bd69-ac3a66e1e687 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:47 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "6a76a230-e352-46c5-bec1-7d283ac41b19"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-unplugged", "status": "completed", "tag": "a73bbd65-caef-437c-abd9-6d2ccc977830"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "a73bbd65-caef-437c-abd9-6d2ccc977830"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:47 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Creating event network-vif-plugged:6a76a230-e352-46c5-bec1-7d283ac41b19 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:47 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Creating event network-vif-unplugged:a73bbd65-caef-437c-abd9-6d2ccc977830 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:47 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Creating event network-vif-plugged:a73bbd65-caef-437c-abd9-6d2ccc977830 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:47 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.040374 Apr 14 15:39:47 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 75/226] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:47 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:48 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-6caf6f7b-bcd1-4fe9-bd69-ac3a66e1e687 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16729d95f2742578646f5b33dedb48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140cbbc3a56d44eb99f7759080f26fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:48 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-6caf6f7b-bcd1-4fe9-bd69-ac3a66e1e687 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd16729d95f2742578646f5b33dedb48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140cbbc3a56d44eb99f7759080f26fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:48 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-6caf6f7b-bcd1-4fe9-bd69-ac3a66e1e687 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd16729d95f2742578646f5b33dedb48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140cbbc3a56d44eb99f7759080f26fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:39:48 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-6caf6f7b-bcd1-4fe9-bd69-ac3a66e1e687 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2" status: 200 len: 2947 microversion: 2.32 time: 0.718644 Apr 14 15:39:48 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 76/227] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:39:47 2023] GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2 => generated 2947 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 15:39:48 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-unplugged", "status": "completed", "tag": "ecc253cf-3d0b-4f54-8f5b-f3520753f121"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "ecc253cf-3d0b-4f54-8f5b-f3520753f121"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-unplugged", "status": "completed", "tag": "f10a6caa-5805-4f6b-9082-7835563229c1"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-plugged", "status": "completed", "tag": "f10a6caa-5805-4f6b-9082-7835563229c1"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-unplugged", "status": "completed", "tag": "ee1af132-bea9-465f-8b76-264c96b3f02b"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:48 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:48 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:48 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:48 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Creating event network-vif-plugged:67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:48 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Creating event network-vif-unplugged:ecc253cf-3d0b-4f54-8f5b-f3520753f121 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:48 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Creating event network-vif-plugged:ecc253cf-3d0b-4f54-8f5b-f3520753f121 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:48 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Creating event network-vif-unplugged:f10a6caa-5805-4f6b-9082-7835563229c1 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:48 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Creating event network-vif-plugged:f10a6caa-5805-4f6b-9082-7835563229c1 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:48 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Creating event network-vif-unplugged:ee1af132-bea9-465f-8b76-264c96b3f02b for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:48 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1044 microversion: 2.1 time: 0.050324 Apr 14 15:39:48 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 77/228] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:48 2023] POST /compute/v2.1/os-server-external-events => generated 1044 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:39:49 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-unplugged", "status": "completed", "tag": "25141225-c1dd-4587-8056-04b3c44668c6"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "25141225-c1dd-4587-8056-04b3c44668c6"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] Creating event network-vif-unplugged:25141225-c1dd-4587-8056-04b3c44668c6 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] Creating event network-vif-plugged:25141225-c1dd-4587-8056-04b3c44668c6 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.072381 Apr 14 15:39:49 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 76/229] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:49 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:49 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-unplugged", "status": "completed", "tag": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-unplugged", "status": "completed", "tag": "a1397aaf-d530-448a-9827-824d37cf44ba"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "a1397aaf-d530-448a-9827-824d37cf44ba"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-unplugged", "status": "completed", "tag": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:49 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Creating event network-vif-unplugged:4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:49 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Creating event network-vif-plugged:4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:49 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Creating event network-vif-unplugged:a1397aaf-d530-448a-9827-824d37cf44ba for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:49 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Creating event network-vif-plugged:a1397aaf-d530-448a-9827-824d37cf44ba for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:49 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Creating event network-vif-unplugged:d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:49 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Creating event network-vif-plugged:d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:50 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1044 microversion: 2.1 time: 0.039049 Apr 14 15:39:50 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 77/230] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:49 2023] POST /compute/v2.1/os-server-external-events => generated 1044 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:39:50 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "ee1af132-bea9-465f-8b76-264c96b3f02b"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-unplugged", "status": "completed", "tag": "6092e2c0-2114-4909-aeca-bb8b43a1c220"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "6092e2c0-2114-4909-aeca-bb8b43a1c220"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-unplugged", "status": "completed", "tag": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-plugged", "status": "completed", "tag": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:50 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Creating event network-vif-plugged:ee1af132-bea9-465f-8b76-264c96b3f02b for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:50 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Creating event network-vif-unplugged:6092e2c0-2114-4909-aeca-bb8b43a1c220 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:50 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Creating event network-vif-plugged:6092e2c0-2114-4909-aeca-bb8b43a1c220 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:50 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Creating event network-vif-unplugged:a7786e2f-3d52-4ec4-8e66-9221db2c3e3e for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:50 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Creating event network-vif-plugged:a7786e2f-3d52-4ec4-8e66-9221db2c3e3e for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:50 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.035439 Apr 14 15:39:50 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 78/231] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:50 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b635e6be-231b-4421-ba9d-8a4e3ecdb321 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-b635e6be-231b-4421-ba9d-8a4e3ecdb321 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b635e6be-231b-4421-ba9d-8a4e3ecdb321 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b635e6be-231b-4421-ba9d-8a4e3ecdb321 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b635e6be-231b-4421-ba9d-8a4e3ecdb321 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b635e6be-231b-4421-ba9d-8a4e3ecdb321 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b635e6be-231b-4421-ba9d-8a4e3ecdb321 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b635e6be-231b-4421-ba9d-8a4e3ecdb321 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:50 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-b635e6be-231b-4421-ba9d-8a4e3ecdb321 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042022 Apr 14 15:39:50 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 77/232] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:39:50 2023] GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:50 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-415f18ba-d619-4be0-94cf-8fc107579c2c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:50 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-415f18ba-d619-4be0-94cf-8fc107579c2c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-415f18ba-d619-4be0-94cf-8fc107579c2c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-415f18ba-d619-4be0-94cf-8fc107579c2c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-415f18ba-d619-4be0-94cf-8fc107579c2c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-415f18ba-d619-4be0-94cf-8fc107579c2c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-415f18ba-d619-4be0-94cf-8fc107579c2c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-415f18ba-d619-4be0-94cf-8fc107579c2c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:50 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-415f18ba-d619-4be0-94cf-8fc107579c2c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050222 Apr 14 15:39:50 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 78/233] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:39:50 2023] GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:50 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:50 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:50 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lazy-loading 'services' on Instance uuid 31b57881-e95e-41d5-9f78-61d95ecfd93a {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:39:50 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments/b0050c51-18a0-48f3-9758-29d5adf738e1" status: 202 len: 0 microversion: 2.1 time: 0.181940 Apr 14 15:39:50 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 79/234] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:39:50 2023] DELETE /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments/b0050c51-18a0-48f3-9758-29d5adf738e1 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-1173c083-aa73-4950-917a-7381e6bf359e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-1173c083-aa73-4950-917a-7381e6bf359e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1173c083-aa73-4950-917a-7381e6bf359e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1173c083-aa73-4950-917a-7381e6bf359e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1173c083-aa73-4950-917a-7381e6bf359e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1173c083-aa73-4950-917a-7381e6bf359e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1173c083-aa73-4950-917a-7381e6bf359e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1173c083-aa73-4950-917a-7381e6bf359e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:50 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-1173c083-aa73-4950-917a-7381e6bf359e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046808 Apr 14 15:39:50 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 78/235] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:39:50 2023] GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:52 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-34611473-6d79-4dc4-b3c0-81416ffd397c req-937491ea-281b-46da-b70b-4b5044f45a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-deleted", "tag": "a73bbd65-caef-437c-abd9-6d2ccc977830"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-34611473-6d79-4dc4-b3c0-81416ffd397c req-937491ea-281b-46da-b70b-4b5044f45a8c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-34611473-6d79-4dc4-b3c0-81416ffd397c req-937491ea-281b-46da-b70b-4b5044f45a8c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-34611473-6d79-4dc4-b3c0-81416ffd397c req-937491ea-281b-46da-b70b-4b5044f45a8c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:52 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-34611473-6d79-4dc4-b3c0-81416ffd397c req-937491ea-281b-46da-b70b-4b5044f45a8c service nova] Creating event network-vif-deleted:a73bbd65-caef-437c-abd9-6d2ccc977830 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:52 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-34611473-6d79-4dc4-b3c0-81416ffd397c req-937491ea-281b-46da-b70b-4b5044f45a8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027719 Apr 14 15:39:52 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 79/236] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:54 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-deleted", "tag": "e2de16b7-a60f-4fba-ace4-21ab648d036e"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-deleted", "tag": "f10a6caa-5805-4f6b-9082-7835563229c1"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:54 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] Creating event network-vif-deleted:e2de16b7-a60f-4fba-ace4-21ab648d036e for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:54 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] Creating event network-vif-deleted:f10a6caa-5805-4f6b-9082-7835563229c1 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:54 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041348 Apr 14 15:39:54 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 80/237] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:39:56 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-deleted", "tag": "ee1af132-bea9-465f-8b76-264c96b3f02b"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-deleted", "tag": "ecc253cf-3d0b-4f54-8f5b-f3520753f121"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-deleted", "tag": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a"}, {"server_uuid": "f8608ac5-90b2-49e0-b037-93b5a9ed0baa", "name": "network-vif-deleted", "tag": "a5007998-31ee-4618-9fde-ab538bbd8e76"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-deleted", "tag": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e"}, {"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-deleted", "tag": "25141225-c1dd-4587-8056-04b3c44668c6"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] Creating event network-vif-deleted:ee1af132-bea9-465f-8b76-264c96b3f02b for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] Creating event network-vif-deleted:ecc253cf-3d0b-4f54-8f5b-f3520753f121 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] Creating event network-vif-deleted:d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] Creating event network-vif-deleted:a5007998-31ee-4618-9fde-ab538bbd8e76 for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa on user Apr 14 15:39:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] Creating event network-vif-deleted:a7786e2f-3d52-4ec4-8e66-9221db2c3e3e for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] Creating event network-vif-deleted:25141225-c1dd-4587-8056-04b3c44668c6 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.041344 Apr 14 15:39:56 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 79/238] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:56 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:39:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-e6beb797-7b27-461f-8ec1-8b4c6e29d474 req-8aef07f7-a5ac-4525-a4a3-adeb1e7caf6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5b99c-b3e0-4601-be25-1c3053d76ef2", "name": "network-vif-deleted", "tag": "6092e2c0-2114-4909-aeca-bb8b43a1c220"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:39:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-e6beb797-7b27-461f-8ec1-8b4c6e29d474 req-8aef07f7-a5ac-4525-a4a3-adeb1e7caf6d service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:39:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-e6beb797-7b27-461f-8ec1-8b4c6e29d474 req-8aef07f7-a5ac-4525-a4a3-adeb1e7caf6d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:39:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-e6beb797-7b27-461f-8ec1-8b4c6e29d474 req-8aef07f7-a5ac-4525-a4a3-adeb1e7caf6d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:39:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-e6beb797-7b27-461f-8ec1-8b4c6e29d474 req-8aef07f7-a5ac-4525-a4a3-adeb1e7caf6d service nova] Creating event network-vif-deleted:6092e2c0-2114-4909-aeca-bb8b43a1c220 for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 on user Apr 14 15:39:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-e6beb797-7b27-461f-8ec1-8b4c6e29d474 req-8aef07f7-a5ac-4525-a4a3-adeb1e7caf6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032806 Apr 14 15:39:58 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 80/239] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:39:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:40:04 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:04 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:04 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-f5009348-aad5-4c8d-a1b2-720e2072a8fe tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:04 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-f5009348-aad5-4c8d-a1b2-720e2072a8fe tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f5009348-aad5-4c8d-a1b2-720e2072a8fe tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f5009348-aad5-4c8d-a1b2-720e2072a8fe tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f5009348-aad5-4c8d-a1b2-720e2072a8fe tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f5009348-aad5-4c8d-a1b2-720e2072a8fe tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f5009348-aad5-4c8d-a1b2-720e2072a8fe tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f5009348-aad5-4c8d-a1b2-720e2072a8fe tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:04 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-f5009348-aad5-4c8d-a1b2-720e2072a8fe tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059933 Apr 14 15:40:04 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 81/240] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:40:04 2023] GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:40:04 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1429675285", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "f640a309-f997-4ae7-8c15-cd2a0e846ca4"}]}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:04 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:04 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] validate_networks() for [('f640a309-f997-4ae7-8c15-cd2a0e846ca4', None, None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Getting quotas for project 029b8c395f264a86933a9e878c18e0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Getting quotas for user e1aa921f86bd4f3b88eb782d5f667816 and project 029b8c395f264a86933a9e878c18e0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:40:05 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:40:05 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.734377 Apr 14 15:40:05 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 80/241] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:40:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:40:05 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-8a789f57-b6d7-4783-a00f-37d183be99f3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:05 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-8a789f57-b6d7-4783-a00f-37d183be99f3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:05 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-8a789f57-b6d7-4783-a00f-37d183be99f3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1aa921f86bd4f3b88eb782d5f667816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '029b8c395f264a86933a9e878c18e0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:05 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-8a789f57-b6d7-4783-a00f-37d183be99f3 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32" status: 200 len: 1212 microversion: 2.1 time: 0.105575 Apr 14 15:40:05 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 81/242] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:40:05 2023] GET /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32 => generated 1212 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:40:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19de875a-a784-46f6-8c6e-f2fad198ba32", "tag": "12f4faa8-1f30-4403-9114-14195ee6d862"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] Creating event network-changed:12f4faa8-1f30-4403-9114-14195ee6d862 for instance 19de875a-a784-46f6-8c6e-f2fad198ba32 on user Apr 14 15:40:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029867 Apr 14 15:40:08 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 82/243] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:10 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-20fd435f-a0cc-4fd9-86d5-c6b10d6bfbd8 req-f27ec1f9-4c3b-4555-b622-08acebe3af48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19de875a-a784-46f6-8c6e-f2fad198ba32", "name": "network-vif-plugged", "status": "completed", "tag": "12f4faa8-1f30-4403-9114-14195ee6d862"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-20fd435f-a0cc-4fd9-86d5-c6b10d6bfbd8 req-f27ec1f9-4c3b-4555-b622-08acebe3af48 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-20fd435f-a0cc-4fd9-86d5-c6b10d6bfbd8 req-f27ec1f9-4c3b-4555-b622-08acebe3af48 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-20fd435f-a0cc-4fd9-86d5-c6b10d6bfbd8 req-f27ec1f9-4c3b-4555-b622-08acebe3af48 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:10 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-20fd435f-a0cc-4fd9-86d5-c6b10d6bfbd8 req-f27ec1f9-4c3b-4555-b622-08acebe3af48 service nova] Creating event network-vif-plugged:12f4faa8-1f30-4403-9114-14195ee6d862 for instance 19de875a-a784-46f6-8c6e-f2fad198ba32 on user Apr 14 15:40:10 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-20fd435f-a0cc-4fd9-86d5-c6b10d6bfbd8 req-f27ec1f9-4c3b-4555-b622-08acebe3af48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029864 Apr 14 15:40:10 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 81/244] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:12 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-16c26236-2526-4375-b520-e3d62ec6d5e4 req-571ab6cd-ed7a-4774-bf84-1dba9f539f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19de875a-a784-46f6-8c6e-f2fad198ba32", "name": "network-vif-plugged", "status": "completed", "tag": "12f4faa8-1f30-4403-9114-14195ee6d862"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:12 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=37 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:12 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=26 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-16c26236-2526-4375-b520-e3d62ec6d5e4 req-571ab6cd-ed7a-4774-bf84-1dba9f539f37 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-16c26236-2526-4375-b520-e3d62ec6d5e4 req-571ab6cd-ed7a-4774-bf84-1dba9f539f37 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-16c26236-2526-4375-b520-e3d62ec6d5e4 req-571ab6cd-ed7a-4774-bf84-1dba9f539f37 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:12 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-16c26236-2526-4375-b520-e3d62ec6d5e4 req-571ab6cd-ed7a-4774-bf84-1dba9f539f37 service nova] Creating event network-vif-plugged:12f4faa8-1f30-4403-9114-14195ee6d862 for instance 19de875a-a784-46f6-8c6e-f2fad198ba32 on user Apr 14 15:40:12 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-16c26236-2526-4375-b520-e3d62ec6d5e4 req-571ab6cd-ed7a-4774-bf84-1dba9f539f37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052457 Apr 14 15:40:12 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 82/245] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:15 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:15 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:15 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Going to try to terminate instance {{(pid=61876) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:40:15 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" status: 204 len: 0 microversion: 2.1 time: 0.126646 Apr 14 15:40:15 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 83/246] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:40:15 2023] DELETE /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:40:15 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:15 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:15 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-d8b93736-fd72-4b56-bea2-341cade425b3 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:15 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d8b93736-fd72-4b56-bea2-341cade425b3 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d8b93736-fd72-4b56-bea2-341cade425b3 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d8b93736-fd72-4b56-bea2-341cade425b3 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d8b93736-fd72-4b56-bea2-341cade425b3 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d8b93736-fd72-4b56-bea2-341cade425b3 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d8b93736-fd72-4b56-bea2-341cade425b3 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d8b93736-fd72-4b56-bea2-341cade425b3 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:15 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:15 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-47bf2418-3282-4580-a929-92d30d1600dc req-6006cd8e-6e6c-4d83-a3d6-8d5d65409474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62", "name": "network-vif-unplugged", "status": "completed", "tag": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-47bf2418-3282-4580-a929-92d30d1600dc req-6006cd8e-6e6c-4d83-a3d6-8d5d65409474 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-47bf2418-3282-4580-a929-92d30d1600dc req-6006cd8e-6e6c-4d83-a3d6-8d5d65409474 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-47bf2418-3282-4580-a929-92d30d1600dc req-6006cd8e-6e6c-4d83-a3d6-8d5d65409474 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:16 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-47bf2418-3282-4580-a929-92d30d1600dc req-6006cd8e-6e6c-4d83-a3d6-8d5d65409474 service nova] Creating event network-vif-unplugged:2a5e9f47-a62f-4feb-be9c-2a4bc943c378 for instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 on user Apr 14 15:40:16 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-47bf2418-3282-4580-a929-92d30d1600dc req-6006cd8e-6e6c-4d83-a3d6-8d5d65409474 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046534 Apr 14 15:40:16 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 83/247] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:16 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-d8b93736-fd72-4b56-bea2-341cade425b3 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af824b840c604223afd90bce17fe1ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e73ef2ad94e84876def53ddf43da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-d8b93736-fd72-4b56-bea2-341cade425b3 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" status: 200 len: 1501 microversion: 2.1 time: 0.485244 Apr 14 15:40:16 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 82/248] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:40:15 2023] GET /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 => generated 1501 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 15:40:17 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-3a3dc569-5e42-4ed7-8b9e-ca21fb399798 req-955d0c4c-71da-4d4b-9dba-e164ea9f2883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62", "name": "network-vif-deleted", "tag": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-3a3dc569-5e42-4ed7-8b9e-ca21fb399798 req-955d0c4c-71da-4d4b-9dba-e164ea9f2883 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-3a3dc569-5e42-4ed7-8b9e-ca21fb399798 req-955d0c4c-71da-4d4b-9dba-e164ea9f2883 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-3a3dc569-5e42-4ed7-8b9e-ca21fb399798 req-955d0c4c-71da-4d4b-9dba-e164ea9f2883 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:17 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-3a3dc569-5e42-4ed7-8b9e-ca21fb399798 req-955d0c4c-71da-4d4b-9dba-e164ea9f2883 service nova] Creating event network-vif-deleted:2a5e9f47-a62f-4feb-be9c-2a4bc943c378 for instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 on user Apr 14 15:40:17 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-3a3dc569-5e42-4ed7-8b9e-ca21fb399798 req-955d0c4c-71da-4d4b-9dba-e164ea9f2883 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037349 Apr 14 15:40:17 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 84/249] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:18 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62", "name": "network-vif-plugged", "status": "completed", "tag": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378"}, {"server_uuid": "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62", "name": "network-vif-plugged", "status": "completed", "tag": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:18 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] Creating event network-vif-plugged:2a5e9f47-a62f-4feb-be9c-2a4bc943c378 for instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 on user Apr 14 15:40:18 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] Creating event network-vif-plugged:2a5e9f47-a62f-4feb-be9c-2a4bc943c378 for instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 on user Apr 14 15:40:18 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045084 Apr 14 15:40:18 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 84/250] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:22 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-86c102f1-842b-4804-a6ba-2dbfcbd118f8 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:22 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-86c102f1-842b-4804-a6ba-2dbfcbd118f8 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-86c102f1-842b-4804-a6ba-2dbfcbd118f8 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-86c102f1-842b-4804-a6ba-2dbfcbd118f8 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-86c102f1-842b-4804-a6ba-2dbfcbd118f8 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-86c102f1-842b-4804-a6ba-2dbfcbd118f8 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-86c102f1-842b-4804-a6ba-2dbfcbd118f8 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-86c102f1-842b-4804-a6ba-2dbfcbd118f8 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:22 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-86c102f1-842b-4804-a6ba-2dbfcbd118f8 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] HTTP exception thrown: Instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc could not be found. Apr 14 15:40:22 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-86c102f1-842b-4804-a6ba-2dbfcbd118f8 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Request method failure captured: Apr 14 15:40:22 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc HTTP/1.1 Apr 14 15:40:22 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:40:22 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:40:22 user devstack@n-api.service[61875]: Connection: close Apr 14 15:40:22 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:40:22 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:40:22 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:40:22 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:40:22 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXMtotcVO0G4E7-AoD7l4H-tXVvuY_m0csFuGR_IODVAIoCGVz5xVlr6vE_On-VlPyS3PHeX0RMdH1poik1GMYpKlcR491fv5Y6gcnfOFqCssNwWqZbx9qw7UBxqEMEE4kMluPScjGgpbmSrVd4IuOgYyOKVRDa6VKlvYB8sn3rrdjI Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Project-Id: c377cd3ce1454ed5a6257138350802f6 Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Project-Name: tempest-VolumesActionsTest-1954053616 Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c377cd3ce1454ed5a6257138350802f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c377cd3ce1454ed5a6257138350802f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c377cd3ce1454ed5a6257138350802f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Tenant: tempest-VolumesActionsTest-1954053616 Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Tenant-Id: c377cd3ce1454ed5a6257138350802f6 Apr 14 15:40:22 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-VolumesActionsTest-1954053616 Apr 14 15:40:22 user devstack@n-api.service[61875]: X-User: tempest-VolumesActionsTest-1954053616-project-member Apr 14 15:40:22 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:40:22 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:40:22 user devstack@n-api.service[61875]: X-User-Id: 426c9fdcd462435293f2208229c11458 Apr 14 15:40:22 user devstack@n-api.service[61875]: X-User-Name: tempest-VolumesActionsTest-1954053616-project-member Apr 14 15:40:22 user devstack@n-api.service[61875]: method: > Apr 14 15:40:22 user devstack@n-api.service[61875]: exception: Instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc could not be found. Apr 14 15:40:22 user devstack@n-api.service[61875]: action_args: {'id': 'f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc'} Apr 14 15:40:22 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc could not be found. Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc could not be found. Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc could not be found. Apr 14 15:40:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:22 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-86c102f1-842b-4804-a6ba-2dbfcbd118f8 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Returning 404 to user: Instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:40:22 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-86c102f1-842b-4804-a6ba-2dbfcbd118f8 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" status: 404 len: 111 microversion: 2.1 time: 0.036492 Apr 14 15:40:22 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 83/251] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:40:22 2023] GET /compute/v2.1/servers/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:40:24 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-eb18568f-e79e-4c17-9bbf-b99d6b6d03bd tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:24 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-eb18568f-e79e-4c17-9bbf-b99d6b6d03bd tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eb18568f-e79e-4c17-9bbf-b99d6b6d03bd tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eb18568f-e79e-4c17-9bbf-b99d6b6d03bd tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eb18568f-e79e-4c17-9bbf-b99d6b6d03bd tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eb18568f-e79e-4c17-9bbf-b99d6b6d03bd tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eb18568f-e79e-4c17-9bbf-b99d6b6d03bd tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:24 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eb18568f-e79e-4c17-9bbf-b99d6b6d03bd tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:24 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-eb18568f-e79e-4c17-9bbf-b99d6b6d03bd tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-instance-actions/req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4" status: 200 len: 503 microversion: 2.49 time: 0.105573 Apr 14 15:40:24 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 85/252] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 15:40:24 2023] GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-instance-actions/req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 => generated 503 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:40:24 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-ce2b62cf-14f6-4ab8-99f0-6ec231713728 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:24 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-ce2b62cf-14f6-4ab8-99f0-6ec231713728 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ce2b62cf-14f6-4ab8-99f0-6ec231713728 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ce2b62cf-14f6-4ab8-99f0-6ec231713728 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ce2b62cf-14f6-4ab8-99f0-6ec231713728 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ce2b62cf-14f6-4ab8-99f0-6ec231713728 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ce2b62cf-14f6-4ab8-99f0-6ec231713728 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ce2b62cf-14f6-4ab8-99f0-6ec231713728 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-ce2b62cf-14f6-4ab8-99f0-6ec231713728 tempest-TaggedAttachmentsTest-2089188622 tempest-TaggedAttachmentsTest-2089188622-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-instance-actions/req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4" status: 200 len: 503 microversion: 2.49 time: 0.067793 Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-323856204", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "7c17386f-ee51-4b70-936e-ca90f2fb5615"}]}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:25 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 85/253] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 15:40:24 2023] GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-instance-actions/req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 => generated 503 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] validate_networks() for [('7c17386f-ee51-4b70-936e-ca90f2fb5615', None, None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-7dac72f7-55e4-4947-95a0-1fb4f5d5d4d8 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-7dac72f7-55e4-4947-95a0-1fb4f5d5d4d8 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7dac72f7-55e4-4947-95a0-1fb4f5d5d4d8 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7dac72f7-55e4-4947-95a0-1fb4f5d5d4d8 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7dac72f7-55e4-4947-95a0-1fb4f5d5d4d8 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7dac72f7-55e4-4947-95a0-1fb4f5d5d4d8 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7dac72f7-55e4-4947-95a0-1fb4f5d5d4d8 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7dac72f7-55e4-4947-95a0-1fb4f5d5d4d8 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-7dac72f7-55e4-4947-95a0-1fb4f5d5d4d8 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.072714 Apr 14 15:40:25 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 86/254] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 15:40:25 2023] GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5923719a-57d8-4c13-b9c5-46b0399a0d05 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-5923719a-57d8-4c13-b9c5-46b0399a0d05 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5923719a-57d8-4c13-b9c5-46b0399a0d05 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5923719a-57d8-4c13-b9c5-46b0399a0d05 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5923719a-57d8-4c13-b9c5-46b0399a0d05 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5923719a-57d8-4c13-b9c5-46b0399a0d05 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5923719a-57d8-4c13-b9c5-46b0399a0d05 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5923719a-57d8-4c13-b9c5-46b0399a0d05 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-5923719a-57d8-4c13-b9c5-46b0399a0d05 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] HTTP exception thrown: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5923719a-57d8-4c13-b9c5-46b0399a0d05 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Request method failure captured: Apr 14 15:40:25 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 HTTP/1.1 Apr 14 15:40:25 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:40:25 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:40:25 user devstack@n-api.service[61876]: Connection: close Apr 14 15:40:25 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:40:25 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:40:25 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:40:25 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:40:25 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXML4L04UDuWZULeDdBbRYidgCFJF87oTTj6kUflRU6XJUJ5UxUiw3RMoYGfG45TKr0nbpnp8Wi9XJlb-ccOmVploFE2rfPbBu5Xkd6atK8ec8y-e4hYv_xL5pN1LIBJRUJy2Trlm4FSTt01CHJ5hZjYarFDgsQrdVievjFHUrriPmY Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Project-Id: 02da33469a7a477b876331e9b846b99a Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-728467558 Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/02da33469a7a477b876331e9b846b99a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02da33469a7a477b876331e9b846b99a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02da33469a7a477b876331e9b846b99a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-728467558 Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Tenant-Id: 02da33469a7a477b876331e9b846b99a Apr 14 15:40:25 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-728467558 Apr 14 15:40:25 user devstack@n-api.service[61876]: X-User: tempest-AttachSCSIVolumeTestJSON-728467558-project-member Apr 14 15:40:25 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:40:25 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:40:25 user devstack@n-api.service[61876]: X-User-Id: e4611274a77c4f3a8333771568ce9fbc Apr 14 15:40:25 user devstack@n-api.service[61876]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-728467558-project-member Apr 14 15:40:25 user devstack@n-api.service[61876]: method: > Apr 14 15:40:25 user devstack@n-api.service[61876]: exception: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:25 user devstack@n-api.service[61876]: action_args: {'id': '5cffd4a1-2cc7-4048-8902-ed914e6f0ff3'} Apr 14 15:40:25 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:25 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5923719a-57d8-4c13-b9c5-46b0399a0d05 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Returning 404 to user: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:40:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5923719a-57d8-4c13-b9c5-46b0399a0d05 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" status: 404 len: 111 microversion: 2.1 time: 0.037162 Apr 14 15:40:25 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 87/255] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:40:25 2023] GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-7727b0c3-abe6-4b79-9a7e-97cee1071254 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Calling method '.version_select at 0x7f2970cc6ef0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-7727b0c3-abe6-4b79-9a7e-97cee1071254 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207070274" status: 202 len: 0 microversion: 2.1 time: 0.026175 Apr 14 15:40:25 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 88/256] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 15:40:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207070274 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 15:40:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5" status: 204 len: 0 microversion: 2.49 time: 0.144311 Apr 14 15:40:25 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 86/257] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 15:40:25 2023] DELETE /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-d50a511d-e8ce-4bdc-82f1-09cab2adef82 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-d50a511d-e8ce-4bdc-82f1-09cab2adef82 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d50a511d-e8ce-4bdc-82f1-09cab2adef82 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d50a511d-e8ce-4bdc-82f1-09cab2adef82 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d50a511d-e8ce-4bdc-82f1-09cab2adef82 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d50a511d-e8ce-4bdc-82f1-09cab2adef82 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d50a511d-e8ce-4bdc-82f1-09cab2adef82 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d50a511d-e8ce-4bdc-82f1-09cab2adef82 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting quotas for project 584a53650c014f87b9622f2011996200. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting quotas for user efb645d110464e7e85d7c955ee9f3466 and project 584a53650c014f87b9622f2011996200. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:40:25 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:40:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.927436 Apr 14 15:40:25 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 84/258] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 15:40:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 15:40:25 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-86eba4a8-2217-4641-bd0f-9dda2f9cd177 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:26 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-86eba4a8-2217-4641-bd0f-9dda2f9cd177 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:26 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-86eba4a8-2217-4641-bd0f-9dda2f9cd177 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:26 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-86eba4a8-2217-4641-bd0f-9dda2f9cd177 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:26 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-6b917cf4-b152-453b-8c3f-c3ae911940bd req-c975c0a7-6ffb-429f-92fd-d9f4073b1022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112ffb8d-fef8-4ffd-991c-626c7e4c85b5", "name": "network-vif-unplugged", "status": "completed", "tag": "1f6caa20-5ea5-475a-8060-25725837c3c5"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:26 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-86eba4a8-2217-4641-bd0f-9dda2f9cd177 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:26 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-d50a511d-e8ce-4bdc-82f1-09cab2adef82 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:26 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-86eba4a8-2217-4641-bd0f-9dda2f9cd177 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" status: 200 len: 1394 microversion: 2.87 time: 0.099922 Apr 14 15:40:26 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 87/259] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:40:25 2023] GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => generated 1394 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:40:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6b917cf4-b152-453b-8c3f-c3ae911940bd req-c975c0a7-6ffb-429f-92fd-d9f4073b1022 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6b917cf4-b152-453b-8c3f-c3ae911940bd req-c975c0a7-6ffb-429f-92fd-d9f4073b1022 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6b917cf4-b152-453b-8c3f-c3ae911940bd req-c975c0a7-6ffb-429f-92fd-d9f4073b1022 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:26 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-d50a511d-e8ce-4bdc-82f1-09cab2adef82 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:26 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-d50a511d-e8ce-4bdc-82f1-09cab2adef82 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:26 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-d50a511d-e8ce-4bdc-82f1-09cab2adef82 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5" status: 200 len: 1753 microversion: 2.49 time: 0.647755 Apr 14 15:40:26 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 89/260] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:40:25 2023] GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5 => generated 1753 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:40:26 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-6b917cf4-b152-453b-8c3f-c3ae911940bd req-c975c0a7-6ffb-429f-92fd-d9f4073b1022 service nova] Creating event network-vif-unplugged:1f6caa20-5ea5-475a-8060-25725837c3c5 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 on user Apr 14 15:40:26 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-6b917cf4-b152-453b-8c3f-c3ae911940bd req-c975c0a7-6ffb-429f-92fd-d9f4073b1022 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044246 Apr 14 15:40:26 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 85/261] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:27 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-32a09202-0497-4c74-9d09-ea86f3049f16 req-1d865c91-2a84-43f4-a711-b5662015e174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112ffb8d-fef8-4ffd-991c-626c7e4c85b5", "name": "network-vif-deleted", "tag": "1f6caa20-5ea5-475a-8060-25725837c3c5"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-32a09202-0497-4c74-9d09-ea86f3049f16 req-1d865c91-2a84-43f4-a711-b5662015e174 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-32a09202-0497-4c74-9d09-ea86f3049f16 req-1d865c91-2a84-43f4-a711-b5662015e174 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-32a09202-0497-4c74-9d09-ea86f3049f16 req-1d865c91-2a84-43f4-a711-b5662015e174 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:27 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-32a09202-0497-4c74-9d09-ea86f3049f16 req-1d865c91-2a84-43f4-a711-b5662015e174 service nova] Creating event network-vif-deleted:1f6caa20-5ea5-475a-8060-25725837c3c5 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 on user Apr 14 15:40:27 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-32a09202-0497-4c74-9d09-ea86f3049f16 req-1d865c91-2a84-43f4-a711-b5662015e174 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036667 Apr 14 15:40:27 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 88/262] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-c88a6d14-e7ca-4cfd-a3c5-bd58a5906645 req-4a1d1109-9409-4ae0-bd55-7535056dd928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112ffb8d-fef8-4ffd-991c-626c7e4c85b5", "name": "network-vif-plugged", "status": "completed", "tag": "1f6caa20-5ea5-475a-8060-25725837c3c5"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c88a6d14-e7ca-4cfd-a3c5-bd58a5906645 req-4a1d1109-9409-4ae0-bd55-7535056dd928 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c88a6d14-e7ca-4cfd-a3c5-bd58a5906645 req-4a1d1109-9409-4ae0-bd55-7535056dd928 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c88a6d14-e7ca-4cfd-a3c5-bd58a5906645 req-4a1d1109-9409-4ae0-bd55-7535056dd928 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-c88a6d14-e7ca-4cfd-a3c5-bd58a5906645 req-4a1d1109-9409-4ae0-bd55-7535056dd928 service nova] Creating event network-vif-plugged:1f6caa20-5ea5-475a-8060-25725837c3c5 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 on user Apr 14 15:40:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-c88a6d14-e7ca-4cfd-a3c5-bd58a5906645 req-4a1d1109-9409-4ae0-bd55-7535056dd928 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037377 Apr 14 15:40:28 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 90/263] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-25ac8c61-c3b1-4190-8276-01c0d5220f0c tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:28 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-25ac8c61-c3b1-4190-8276-01c0d5220f0c tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-25ac8c61-c3b1-4190-8276-01c0d5220f0c tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-25ac8c61-c3b1-4190-8276-01c0d5220f0c tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-25ac8c61-c3b1-4190-8276-01c0d5220f0c tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-25ac8c61-c3b1-4190-8276-01c0d5220f0c tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-25ac8c61-c3b1-4190-8276-01c0d5220f0c tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-25ac8c61-c3b1-4190-8276-01c0d5220f0c tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:28 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-25ac8c61-c3b1-4190-8276-01c0d5220f0c tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-25ac8c61-c3b1-4190-8276-01c0d5220f0c tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4" status: 200 len: 1502 microversion: 2.1 time: 0.258503 Apr 14 15:40:28 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 86/264] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:40:28 2023] GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4 => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:40:29 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:29 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:29 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:29 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:29 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] Creating event network-changed:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:40:29 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029162 Apr 14 15:40:29 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 89/265] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:30 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ae91d66c-88ef-475d-ad7f-f79d9d0c2b72 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:30 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ae91d66c-88ef-475d-ad7f-f79d9d0c2b72 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ae91d66c-88ef-475d-ad7f-f79d9d0c2b72 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ae91d66c-88ef-475d-ad7f-f79d9d0c2b72 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ae91d66c-88ef-475d-ad7f-f79d9d0c2b72 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ae91d66c-88ef-475d-ad7f-f79d9d0c2b72 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ae91d66c-88ef-475d-ad7f-f79d9d0c2b72 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ae91d66c-88ef-475d-ad7f-f79d9d0c2b72 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:30 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-ae91d66c-88ef-475d-ad7f-f79d9d0c2b72 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f805db20d87d4429981c975ebd88ed92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8230c5386464f288fd783b3c60536b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:30 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ae91d66c-88ef-475d-ad7f-f79d9d0c2b72 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed" status: 200 len: 1669 microversion: 2.1 time: 0.255041 Apr 14 15:40:30 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 91/266] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:40:30 2023] GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed => generated 1669 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:40:30 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bc8d7c17-16e6-45c4-9d25-43f304544c03 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:30 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-bc8d7c17-16e6-45c4-9d25-43f304544c03 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bc8d7c17-16e6-45c4-9d25-43f304544c03 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bc8d7c17-16e6-45c4-9d25-43f304544c03 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bc8d7c17-16e6-45c4-9d25-43f304544c03 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bc8d7c17-16e6-45c4-9d25-43f304544c03 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bc8d7c17-16e6-45c4-9d25-43f304544c03 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bc8d7c17-16e6-45c4-9d25-43f304544c03 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:30 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-bc8d7c17-16e6-45c4-9d25-43f304544c03 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] HTTP exception thrown: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:30 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bc8d7c17-16e6-45c4-9d25-43f304544c03 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Request method failure captured: Apr 14 15:40:30 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 HTTP/1.1 Apr 14 15:40:30 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:40:30 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:40:30 user devstack@n-api.service[61875]: Connection: close Apr 14 15:40:30 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:40:30 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:40:30 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:40:30 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:40:30 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXML4L04UDuWZULeDdBbRYidgCFJF87oTTj6kUflRU6XJUJ5UxUiw3RMoYGfG45TKr0nbpnp8Wi9XJlb-ccOmVploFE2rfPbBu5Xkd6atK8ec8y-e4hYv_xL5pN1LIBJRUJy2Trlm4FSTt01CHJ5hZjYarFDgsQrdVievjFHUrriPmY Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Project-Id: 02da33469a7a477b876331e9b846b99a Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-728467558 Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/02da33469a7a477b876331e9b846b99a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02da33469a7a477b876331e9b846b99a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02da33469a7a477b876331e9b846b99a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-728467558 Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Tenant-Id: 02da33469a7a477b876331e9b846b99a Apr 14 15:40:30 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-728467558 Apr 14 15:40:30 user devstack@n-api.service[61875]: X-User: tempest-AttachSCSIVolumeTestJSON-728467558-project-member Apr 14 15:40:30 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:40:30 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:40:30 user devstack@n-api.service[61875]: X-User-Id: e4611274a77c4f3a8333771568ce9fbc Apr 14 15:40:30 user devstack@n-api.service[61875]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-728467558-project-member Apr 14 15:40:30 user devstack@n-api.service[61875]: method: > Apr 14 15:40:30 user devstack@n-api.service[61875]: exception: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:30 user devstack@n-api.service[61875]: action_args: {'id': '5cffd4a1-2cc7-4048-8902-ed914e6f0ff3'} Apr 14 15:40:30 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:30 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:30 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bc8d7c17-16e6-45c4-9d25-43f304544c03 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Returning 404 to user: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:40:30 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-bc8d7c17-16e6-45c4-9d25-43f304544c03 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" status: 404 len: 111 microversion: 2.1 time: 0.030656 Apr 14 15:40:30 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 87/267] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:40:30 2023] DELETE /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:40:30 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-9a340286-20e8-44f7-b349-664cf05a9f94 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:30 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-9a340286-20e8-44f7-b349-664cf05a9f94 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9a340286-20e8-44f7-b349-664cf05a9f94 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9a340286-20e8-44f7-b349-664cf05a9f94 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9a340286-20e8-44f7-b349-664cf05a9f94 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9a340286-20e8-44f7-b349-664cf05a9f94 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9a340286-20e8-44f7-b349-664cf05a9f94 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9a340286-20e8-44f7-b349-664cf05a9f94 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-9a340286-20e8-44f7-b349-664cf05a9f94 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] HTTP exception thrown: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:30 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-9a340286-20e8-44f7-b349-664cf05a9f94 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Request method failure captured: Apr 14 15:40:30 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 HTTP/1.1 Apr 14 15:40:30 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:40:30 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:40:30 user devstack@n-api.service[61874]: Connection: close Apr 14 15:40:30 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:40:30 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:40:30 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:40:30 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:40:30 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXML4L04UDuWZULeDdBbRYidgCFJF87oTTj6kUflRU6XJUJ5UxUiw3RMoYGfG45TKr0nbpnp8Wi9XJlb-ccOmVploFE2rfPbBu5Xkd6atK8ec8y-e4hYv_xL5pN1LIBJRUJy2Trlm4FSTt01CHJ5hZjYarFDgsQrdVievjFHUrriPmY Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Project-Id: 02da33469a7a477b876331e9b846b99a Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-728467558 Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/02da33469a7a477b876331e9b846b99a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02da33469a7a477b876331e9b846b99a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02da33469a7a477b876331e9b846b99a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-728467558 Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Tenant-Id: 02da33469a7a477b876331e9b846b99a Apr 14 15:40:30 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-728467558 Apr 14 15:40:30 user devstack@n-api.service[61874]: X-User: tempest-AttachSCSIVolumeTestJSON-728467558-project-member Apr 14 15:40:30 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:40:30 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:40:30 user devstack@n-api.service[61874]: X-User-Id: e4611274a77c4f3a8333771568ce9fbc Apr 14 15:40:30 user devstack@n-api.service[61874]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-728467558-project-member Apr 14 15:40:30 user devstack@n-api.service[61874]: method: > Apr 14 15:40:30 user devstack@n-api.service[61874]: exception: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:30 user devstack@n-api.service[61874]: action_args: {'id': '5cffd4a1-2cc7-4048-8902-ed914e6f0ff3'} Apr 14 15:40:30 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. Apr 14 15:40:30 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:40:30 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-9a340286-20e8-44f7-b349-664cf05a9f94 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Returning 404 to user: Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:40:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-9a340286-20e8-44f7-b349-664cf05a9f94 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" status: 404 len: 111 microversion: 2.1 time: 0.045918 Apr 14 15:40:30 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 90/268] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:40:30 2023] GET /compute/v2.1/servers/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:40:33 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f60c4f2-a281-469b-9c0e-cf96631f965c"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:33 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:33 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317230 Apr 14 15:40:33 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 92/269] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:40:33 2023] POST /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:35 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c700c5dd-d082-4bbc-ae51-b035123ab2a9 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:35 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-c700c5dd-d082-4bbc-ae51-b035123ab2a9 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:35 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c700c5dd-d082-4bbc-ae51-b035123ab2a9 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c700c5dd-d082-4bbc-ae51-b035123ab2a9 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c700c5dd-d082-4bbc-ae51-b035123ab2a9 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c700c5dd-d082-4bbc-ae51-b035123ab2a9 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c700c5dd-d082-4bbc-ae51-b035123ab2a9 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c700c5dd-d082-4bbc-ae51-b035123ab2a9 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:35 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=24 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-c700c5dd-d082-4bbc-ae51-b035123ab2a9 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] HTTP exception thrown: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:35 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c700c5dd-d082-4bbc-ae51-b035123ab2a9 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Request method failure captured: Apr 14 15:40:35 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa HTTP/1.1 Apr 14 15:40:35 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:40:35 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:40:35 user devstack@n-api.service[61875]: Connection: close Apr 14 15:40:35 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:40:35 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:40:35 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:40:35 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:40:35 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXMDVlN-ib0V-hklvqtnz-EOxTkYWopbZCST5GOcZEVk5ab9OA1Ne2iV5_ld5SS3ZXsdyo9p-7xhxbVlIMNq1XJw_SpaueWWe_rJF249F5bcz2spRXWmakuvgU-MagVDQHlUQ222a9YfDWIQF_TRNaJc_VfjaZqV0bq0jQF5mFUdhj0 Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Project-Id: dad6fcd223054486a97d9cbc369eff77 Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2101773777 Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dad6fcd223054486a97d9cbc369eff77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dad6fcd223054486a97d9cbc369eff77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dad6fcd223054486a97d9cbc369eff77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2101773777 Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Tenant-Id: dad6fcd223054486a97d9cbc369eff77 Apr 14 15:40:35 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2101773777 Apr 14 15:40:35 user devstack@n-api.service[61875]: X-User: tempest-TaggedBootDevicesTest_v242-2101773777-project-member Apr 14 15:40:35 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:40:35 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:40:35 user devstack@n-api.service[61875]: X-User-Id: 063d123ffa4f4695bcec3583831b6097 Apr 14 15:40:35 user devstack@n-api.service[61875]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2101773777-project-member Apr 14 15:40:35 user devstack@n-api.service[61875]: method: > Apr 14 15:40:35 user devstack@n-api.service[61875]: exception: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:35 user devstack@n-api.service[61875]: action_args: {'id': 'f8608ac5-90b2-49e0-b037-93b5a9ed0baa'} Apr 14 15:40:35 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:35 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c700c5dd-d082-4bbc-ae51-b035123ab2a9 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Returning 404 to user: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:40:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-c700c5dd-d082-4bbc-ae51-b035123ab2a9 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa" status: 404 len: 111 microversion: 2.42 time: 0.053550 Apr 14 15:40:35 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 88/270] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:40:35 2023] GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:40:35 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-8647de32-c12b-421a-8f15-2ed98ccb5b43 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Calling method '.version_select at 0x7f2970cc3250>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:35 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-8647de32-c12b-421a-8f15-2ed98ccb5b43 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185062635" status: 204 len: 0 microversion: 2.42 time: 0.060300 Apr 14 15:40:35 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 91/271] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 15:40:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185062635 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 15:40:38 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-9306c19d-8cbd-4f0e-9fd0-0e5cc4ee154c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:38 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-9306c19d-8cbd-4f0e-9fd0-0e5cc4ee154c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:38 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9306c19d-8cbd-4f0e-9fd0-0e5cc4ee154c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9306c19d-8cbd-4f0e-9fd0-0e5cc4ee154c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9306c19d-8cbd-4f0e-9fd0-0e5cc4ee154c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9306c19d-8cbd-4f0e-9fd0-0e5cc4ee154c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9306c19d-8cbd-4f0e-9fd0-0e5cc4ee154c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9306c19d-8cbd-4f0e-9fd0-0e5cc4ee154c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:38 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:38 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-9306c19d-8cbd-4f0e-9fd0-0e5cc4ee154c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] HTTP exception thrown: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:38 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-9306c19d-8cbd-4f0e-9fd0-0e5cc4ee154c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Request method failure captured: Apr 14 15:40:38 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2 HTTP/1.1 Apr 14 15:40:38 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:40:38 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:40:38 user devstack@n-api.service[61876]: Connection: close Apr 14 15:40:38 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:40:38 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:40:38 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:40:38 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:40:38 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXMIT2W8B0AlumHx5qY-4alc48e0Q3JedWTluk22sMgD3fjfWsyoEcLZvldBTUH2pr9csntqSGZakKfYdTwTrOKPi2J4T4H9Z3XBYzqVTJ7M9LdpNRbm-5NXATpi0KTXZB5g1zSUAw99BfCnSa9DiOrMhP02m0zv1WxPP3wRwQngJnQ Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Project-Id: 140cbbc3a56d44eb99f7759080f26fcb Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Project-Name: tempest-TaggedBootDevicesTest-1487077847 Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/140cbbc3a56d44eb99f7759080f26fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/140cbbc3a56d44eb99f7759080f26fcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/140cbbc3a56d44eb99f7759080f26fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Tenant: tempest-TaggedBootDevicesTest-1487077847 Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Tenant-Id: 140cbbc3a56d44eb99f7759080f26fcb Apr 14 15:40:38 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1487077847 Apr 14 15:40:38 user devstack@n-api.service[61876]: X-User: tempest-TaggedBootDevicesTest-1487077847-project-member Apr 14 15:40:38 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:40:38 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:40:38 user devstack@n-api.service[61876]: X-User-Id: d16729d95f2742578646f5b33dedb48b Apr 14 15:40:38 user devstack@n-api.service[61876]: X-User-Name: tempest-TaggedBootDevicesTest-1487077847-project-member Apr 14 15:40:38 user devstack@n-api.service[61876]: method: > Apr 14 15:40:38 user devstack@n-api.service[61876]: exception: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:38 user devstack@n-api.service[61876]: action_args: {'id': '02f5b99c-b3e0-4601-be25-1c3053d76ef2'} Apr 14 15:40:38 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:38 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:38 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-9306c19d-8cbd-4f0e-9fd0-0e5cc4ee154c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Returning 404 to user: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:40:38 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-9306c19d-8cbd-4f0e-9fd0-0e5cc4ee154c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2" status: 404 len: 111 microversion: 2.32 time: 0.040334 Apr 14 15:40:38 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 93/272] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:40:38 2023] GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:40:38 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c1ccc686-67a3-4bca-aabd-78efa0114e3b tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Calling method '.version_select at 0x7f2970b1edd0>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:38 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:38 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-c1ccc686-67a3-4bca-aabd-78efa0114e3b tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774536726" status: 204 len: 0 microversion: 2.32 time: 0.032105 Apr 14 15:40:38 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 89/273] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 15:40:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774536726 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 15:40:40 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:40 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4f86542d-ad4a-4fc6-9bcf-742fc2ce0506 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:40 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-4f86542d-ad4a-4fc6-9bcf-742fc2ce0506 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4f86542d-ad4a-4fc6-9bcf-742fc2ce0506 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4f86542d-ad4a-4fc6-9bcf-742fc2ce0506 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4f86542d-ad4a-4fc6-9bcf-742fc2ce0506 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4f86542d-ad4a-4fc6-9bcf-742fc2ce0506 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4f86542d-ad4a-4fc6-9bcf-742fc2ce0506 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4f86542d-ad4a-4fc6-9bcf-742fc2ce0506 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:40 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-4f86542d-ad4a-4fc6-9bcf-742fc2ce0506 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] HTTP exception thrown: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:40 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4f86542d-ad4a-4fc6-9bcf-742fc2ce0506 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Request method failure captured: Apr 14 15:40:40 user devstack@n-api.service[61874]: request: DELETE /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa HTTP/1.1 Apr 14 15:40:40 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:40:40 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:40:40 user devstack@n-api.service[61874]: Connection: close Apr 14 15:40:40 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:40:40 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:40:40 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:40:40 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:40:40 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXMDVlN-ib0V-hklvqtnz-EOxTkYWopbZCST5GOcZEVk5ab9OA1Ne2iV5_ld5SS3ZXsdyo9p-7xhxbVlIMNq1XJw_SpaueWWe_rJF249F5bcz2spRXWmakuvgU-MagVDQHlUQ222a9YfDWIQF_TRNaJc_VfjaZqV0bq0jQF5mFUdhj0 Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Project-Id: dad6fcd223054486a97d9cbc369eff77 Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2101773777 Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dad6fcd223054486a97d9cbc369eff77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dad6fcd223054486a97d9cbc369eff77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dad6fcd223054486a97d9cbc369eff77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2101773777 Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Tenant-Id: dad6fcd223054486a97d9cbc369eff77 Apr 14 15:40:40 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2101773777 Apr 14 15:40:40 user devstack@n-api.service[61874]: X-User: tempest-TaggedBootDevicesTest_v242-2101773777-project-member Apr 14 15:40:40 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:40:40 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:40:40 user devstack@n-api.service[61874]: X-User-Id: 063d123ffa4f4695bcec3583831b6097 Apr 14 15:40:40 user devstack@n-api.service[61874]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2101773777-project-member Apr 14 15:40:40 user devstack@n-api.service[61874]: method: > Apr 14 15:40:40 user devstack@n-api.service[61874]: exception: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:40 user devstack@n-api.service[61874]: action_args: {'id': 'f8608ac5-90b2-49e0-b037-93b5a9ed0baa'} Apr 14 15:40:40 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:40 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:40:40 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4f86542d-ad4a-4fc6-9bcf-742fc2ce0506 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Returning 404 to user: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:40:40 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-4f86542d-ad4a-4fc6-9bcf-742fc2ce0506 tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa" status: 404 len: 111 microversion: 2.42 time: 0.050723 Apr 14 15:40:40 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 92/274] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 15:40:40 2023] DELETE /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:40:40 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-4818dd6a-0dc9-458d-8548-681289c2ff4a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:40 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-4818dd6a-0dc9-458d-8548-681289c2ff4a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4818dd6a-0dc9-458d-8548-681289c2ff4a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4818dd6a-0dc9-458d-8548-681289c2ff4a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4818dd6a-0dc9-458d-8548-681289c2ff4a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4818dd6a-0dc9-458d-8548-681289c2ff4a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4818dd6a-0dc9-458d-8548-681289c2ff4a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4818dd6a-0dc9-458d-8548-681289c2ff4a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:40 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-4818dd6a-0dc9-458d-8548-681289c2ff4a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] HTTP exception thrown: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:40 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-4818dd6a-0dc9-458d-8548-681289c2ff4a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Request method failure captured: Apr 14 15:40:40 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa HTTP/1.1 Apr 14 15:40:40 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:40:40 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:40:40 user devstack@n-api.service[61876]: Connection: close Apr 14 15:40:40 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:40:40 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:40:40 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:40:40 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:40:40 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXMDVlN-ib0V-hklvqtnz-EOxTkYWopbZCST5GOcZEVk5ab9OA1Ne2iV5_ld5SS3ZXsdyo9p-7xhxbVlIMNq1XJw_SpaueWWe_rJF249F5bcz2spRXWmakuvgU-MagVDQHlUQ222a9YfDWIQF_TRNaJc_VfjaZqV0bq0jQF5mFUdhj0 Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Project-Id: dad6fcd223054486a97d9cbc369eff77 Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2101773777 Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dad6fcd223054486a97d9cbc369eff77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dad6fcd223054486a97d9cbc369eff77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dad6fcd223054486a97d9cbc369eff77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2101773777 Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Tenant-Id: dad6fcd223054486a97d9cbc369eff77 Apr 14 15:40:40 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2101773777 Apr 14 15:40:40 user devstack@n-api.service[61876]: X-User: tempest-TaggedBootDevicesTest_v242-2101773777-project-member Apr 14 15:40:40 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:40:40 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:40:40 user devstack@n-api.service[61876]: X-User-Id: 063d123ffa4f4695bcec3583831b6097 Apr 14 15:40:40 user devstack@n-api.service[61876]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2101773777-project-member Apr 14 15:40:40 user devstack@n-api.service[61876]: method: > Apr 14 15:40:40 user devstack@n-api.service[61876]: exception: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:40 user devstack@n-api.service[61876]: action_args: {'id': 'f8608ac5-90b2-49e0-b037-93b5a9ed0baa'} Apr 14 15:40:40 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. Apr 14 15:40:40 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:40 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-4818dd6a-0dc9-458d-8548-681289c2ff4a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Returning 404 to user: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:40:40 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-4818dd6a-0dc9-458d-8548-681289c2ff4a tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa" status: 404 len: 111 microversion: 2.42 time: 0.055085 Apr 14 15:40:40 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 94/275] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:40:40 2023] GET /compute/v2.1/servers/f8608ac5-90b2-49e0-b037-93b5a9ed0baa => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:40:40 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-02eb5c97-afb6-42a6-bbb1-547f1431c76c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:40 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-02eb5c97-afb6-42a6-bbb1-547f1431c76c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-02eb5c97-afb6-42a6-bbb1-547f1431c76c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-02eb5c97-afb6-42a6-bbb1-547f1431c76c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-02eb5c97-afb6-42a6-bbb1-547f1431c76c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-02eb5c97-afb6-42a6-bbb1-547f1431c76c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-02eb5c97-afb6-42a6-bbb1-547f1431c76c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-02eb5c97-afb6-42a6-bbb1-547f1431c76c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:41 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-02eb5c97-afb6-42a6-bbb1-547f1431c76c tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053921 Apr 14 15:40:41 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 90/276] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:40:40 2023] GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:40:41 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:41 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:41 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:40:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a" status: 204 len: 0 microversion: 2.1 time: 0.166355 Apr 14 15:40:41 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 93/277] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:40:41 2023] DELETE /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:40:41 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-f147c563-1b94-4d0c-88f1-077aae190155 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:41 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-f147c563-1b94-4d0c-88f1-077aae190155 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f147c563-1b94-4d0c-88f1-077aae190155 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f147c563-1b94-4d0c-88f1-077aae190155 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f147c563-1b94-4d0c-88f1-077aae190155 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f147c563-1b94-4d0c-88f1-077aae190155 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f147c563-1b94-4d0c-88f1-077aae190155 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f147c563-1b94-4d0c-88f1-077aae190155 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:41 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-f147c563-1b94-4d0c-88f1-077aae190155 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8903273cb7ea4a0c9831dbcc74361ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eb038f3914d54a892a6dabdf6f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-f147c563-1b94-4d0c-88f1-077aae190155 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a" status: 200 len: 1649 microversion: 2.1 time: 0.328980 Apr 14 15:40:41 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 95/278] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:40:41 2023] GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a => generated 1649 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:40:41 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-19888352-b4af-4b53-a6e2-b1cafd1bfff6 req-8742f8bb-3634-4e95-946f-b96187884a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b57881-e95e-41d5-9f78-61d95ecfd93a", "name": "network-vif-unplugged", "status": "completed", "tag": "3bdad8ab-4716-4bb3-b21e-890e392b5430"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-19888352-b4af-4b53-a6e2-b1cafd1bfff6 req-8742f8bb-3634-4e95-946f-b96187884a68 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-19888352-b4af-4b53-a6e2-b1cafd1bfff6 req-8742f8bb-3634-4e95-946f-b96187884a68 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-19888352-b4af-4b53-a6e2-b1cafd1bfff6 req-8742f8bb-3634-4e95-946f-b96187884a68 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:41 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-19888352-b4af-4b53-a6e2-b1cafd1bfff6 req-8742f8bb-3634-4e95-946f-b96187884a68 service nova] Creating event network-vif-unplugged:3bdad8ab-4716-4bb3-b21e-890e392b5430 for instance 31b57881-e95e-41d5-9f78-61d95ecfd93a on user Apr 14 15:40:41 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-19888352-b4af-4b53-a6e2-b1cafd1bfff6 req-8742f8bb-3634-4e95-946f-b96187884a68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052250 Apr 14 15:40:41 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 91/279] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:42 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "c1382ef4-ea4d-4bc8-a660-6abf260444d7"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:42 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:42 user devstack@n-api.service[61874]: DEBUG nova.objects.instance [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'flavor' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=61874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:40:42 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:42 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/action" status: 200 len: 29 microversion: 2.1 time: 0.360079 Apr 14 15:40:42 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 94/280] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:40:42 2023] POST /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/action => generated 29 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:40:42 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-3e6a96a6-e737-4acd-9ba2-b8e9590a2fa3 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:42 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-3e6a96a6-e737-4acd-9ba2-b8e9590a2fa3 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:42 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3e6a96a6-e737-4acd-9ba2-b8e9590a2fa3 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:42 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3e6a96a6-e737-4acd-9ba2-b8e9590a2fa3 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:42 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3e6a96a6-e737-4acd-9ba2-b8e9590a2fa3 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:42 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3e6a96a6-e737-4acd-9ba2-b8e9590a2fa3 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:42 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3e6a96a6-e737-4acd-9ba2-b8e9590a2fa3 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:42 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3e6a96a6-e737-4acd-9ba2-b8e9590a2fa3 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:43 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-3e6a96a6-e737-4acd-9ba2-b8e9590a2fa3 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f805db20d87d4429981c975ebd88ed92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8230c5386464f288fd783b3c60536b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:43 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-3e6a96a6-e737-4acd-9ba2-b8e9590a2fa3 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed" status: 200 len: 1721 microversion: 2.1 time: 0.617491 Apr 14 15:40:43 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 96/281] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:40:42 2023] GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed => generated 1721 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:40:43 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-4a2bb146-f78d-4d51-9bd8-2e1d777330cf req-f3e7772f-b6d2-45f7-9d1d-2a0c9a8be36f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b57881-e95e-41d5-9f78-61d95ecfd93a", "name": "network-vif-deleted", "tag": "3bdad8ab-4716-4bb3-b21e-890e392b5430"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:43 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-4a2bb146-f78d-4d51-9bd8-2e1d777330cf req-f3e7772f-b6d2-45f7-9d1d-2a0c9a8be36f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:43 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-4a2bb146-f78d-4d51-9bd8-2e1d777330cf req-f3e7772f-b6d2-45f7-9d1d-2a0c9a8be36f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:43 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-4a2bb146-f78d-4d51-9bd8-2e1d777330cf req-f3e7772f-b6d2-45f7-9d1d-2a0c9a8be36f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:43 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-4a2bb146-f78d-4d51-9bd8-2e1d777330cf req-f3e7772f-b6d2-45f7-9d1d-2a0c9a8be36f service nova] Creating event network-vif-deleted:3bdad8ab-4716-4bb3-b21e-890e392b5430 for instance 31b57881-e95e-41d5-9f78-61d95ecfd93a on user Apr 14 15:40:43 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-4a2bb146-f78d-4d51-9bd8-2e1d777330cf req-f3e7772f-b6d2-45f7-9d1d-2a0c9a8be36f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035775 Apr 14 15:40:43 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 92/282] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:43 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-c05121fa-1321-4f17-8cda-1ff0f0f0b18c req-66584999-37d0-44ef-baf2-8d0735f33c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b57881-e95e-41d5-9f78-61d95ecfd93a", "name": "network-vif-plugged", "status": "completed", "tag": "3bdad8ab-4716-4bb3-b21e-890e392b5430"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:43 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:40:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-c05121fa-1321-4f17-8cda-1ff0f0f0b18c req-66584999-37d0-44ef-baf2-8d0735f33c13 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-c05121fa-1321-4f17-8cda-1ff0f0f0b18c req-66584999-37d0-44ef-baf2-8d0735f33c13 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-c05121fa-1321-4f17-8cda-1ff0f0f0b18c req-66584999-37d0-44ef-baf2-8d0735f33c13 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:43 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-c05121fa-1321-4f17-8cda-1ff0f0f0b18c req-66584999-37d0-44ef-baf2-8d0735f33c13 service nova] Creating event network-vif-plugged:3bdad8ab-4716-4bb3-b21e-890e392b5430 for instance 31b57881-e95e-41d5-9f78-61d95ecfd93a on user Apr 14 15:40:43 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-c05121fa-1321-4f17-8cda-1ff0f0f0b18c req-66584999-37d0-44ef-baf2-8d0735f33c13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052027 Apr 14 15:40:43 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 95/283] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:44 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-aa484a37-a135-426c-9003-367830783e9c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:44 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-aa484a37-a135-426c-9003-367830783e9c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aa484a37-a135-426c-9003-367830783e9c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aa484a37-a135-426c-9003-367830783e9c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aa484a37-a135-426c-9003-367830783e9c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aa484a37-a135-426c-9003-367830783e9c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aa484a37-a135-426c-9003-367830783e9c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aa484a37-a135-426c-9003-367830783e9c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:44 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-aa484a37-a135-426c-9003-367830783e9c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] HTTP exception thrown: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:44 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-aa484a37-a135-426c-9003-367830783e9c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Request method failure captured: Apr 14 15:40:44 user devstack@n-api.service[61876]: request: DELETE /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2 HTTP/1.1 Apr 14 15:40:44 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:40:44 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:40:44 user devstack@n-api.service[61876]: Connection: close Apr 14 15:40:44 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:40:44 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:40:44 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:40:44 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:40:44 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXMIT2W8B0AlumHx5qY-4alc48e0Q3JedWTluk22sMgD3fjfWsyoEcLZvldBTUH2pr9csntqSGZakKfYdTwTrOKPi2J4T4H9Z3XBYzqVTJ7M9LdpNRbm-5NXATpi0KTXZB5g1zSUAw99BfCnSa9DiOrMhP02m0zv1WxPP3wRwQngJnQ Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Project-Id: 140cbbc3a56d44eb99f7759080f26fcb Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Project-Name: tempest-TaggedBootDevicesTest-1487077847 Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/140cbbc3a56d44eb99f7759080f26fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/140cbbc3a56d44eb99f7759080f26fcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/140cbbc3a56d44eb99f7759080f26fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Tenant: tempest-TaggedBootDevicesTest-1487077847 Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Tenant-Id: 140cbbc3a56d44eb99f7759080f26fcb Apr 14 15:40:44 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1487077847 Apr 14 15:40:44 user devstack@n-api.service[61876]: X-User: tempest-TaggedBootDevicesTest-1487077847-project-member Apr 14 15:40:44 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:40:44 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:40:44 user devstack@n-api.service[61876]: X-User-Id: d16729d95f2742578646f5b33dedb48b Apr 14 15:40:44 user devstack@n-api.service[61876]: X-User-Name: tempest-TaggedBootDevicesTest-1487077847-project-member Apr 14 15:40:44 user devstack@n-api.service[61876]: method: > Apr 14 15:40:44 user devstack@n-api.service[61876]: exception: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:44 user devstack@n-api.service[61876]: action_args: {'id': '02f5b99c-b3e0-4601-be25-1c3053d76ef2'} Apr 14 15:40:44 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:44 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:40:44 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-aa484a37-a135-426c-9003-367830783e9c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Returning 404 to user: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:40:44 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-aa484a37-a135-426c-9003-367830783e9c tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2" status: 404 len: 111 microversion: 2.32 time: 0.043599 Apr 14 15:40:44 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 97/284] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 15:40:44 2023] DELETE /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 14 15:40:44 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a8075e18-c35d-4aad-a0f0-25292fdd8ebc tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:44 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a8075e18-c35d-4aad-a0f0-25292fdd8ebc tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a8075e18-c35d-4aad-a0f0-25292fdd8ebc tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a8075e18-c35d-4aad-a0f0-25292fdd8ebc tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a8075e18-c35d-4aad-a0f0-25292fdd8ebc tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a8075e18-c35d-4aad-a0f0-25292fdd8ebc tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a8075e18-c35d-4aad-a0f0-25292fdd8ebc tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a8075e18-c35d-4aad-a0f0-25292fdd8ebc tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:44 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-a8075e18-c35d-4aad-a0f0-25292fdd8ebc tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] HTTP exception thrown: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:44 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a8075e18-c35d-4aad-a0f0-25292fdd8ebc tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Request method failure captured: Apr 14 15:40:44 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2 HTTP/1.1 Apr 14 15:40:44 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:40:44 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:40:44 user devstack@n-api.service[61875]: Connection: close Apr 14 15:40:44 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:40:44 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:40:44 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:40:44 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:40:44 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXMIT2W8B0AlumHx5qY-4alc48e0Q3JedWTluk22sMgD3fjfWsyoEcLZvldBTUH2pr9csntqSGZakKfYdTwTrOKPi2J4T4H9Z3XBYzqVTJ7M9LdpNRbm-5NXATpi0KTXZB5g1zSUAw99BfCnSa9DiOrMhP02m0zv1WxPP3wRwQngJnQ Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Project-Id: 140cbbc3a56d44eb99f7759080f26fcb Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Project-Name: tempest-TaggedBootDevicesTest-1487077847 Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/140cbbc3a56d44eb99f7759080f26fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/140cbbc3a56d44eb99f7759080f26fcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/140cbbc3a56d44eb99f7759080f26fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Tenant: tempest-TaggedBootDevicesTest-1487077847 Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Tenant-Id: 140cbbc3a56d44eb99f7759080f26fcb Apr 14 15:40:44 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1487077847 Apr 14 15:40:44 user devstack@n-api.service[61875]: X-User: tempest-TaggedBootDevicesTest-1487077847-project-member Apr 14 15:40:44 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:40:44 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:40:44 user devstack@n-api.service[61875]: X-User-Id: d16729d95f2742578646f5b33dedb48b Apr 14 15:40:44 user devstack@n-api.service[61875]: X-User-Name: tempest-TaggedBootDevicesTest-1487077847-project-member Apr 14 15:40:44 user devstack@n-api.service[61875]: method: > Apr 14 15:40:44 user devstack@n-api.service[61875]: exception: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:44 user devstack@n-api.service[61875]: action_args: {'id': '02f5b99c-b3e0-4601-be25-1c3053d76ef2'} Apr 14 15:40:44 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. Apr 14 15:40:44 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:40:44 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a8075e18-c35d-4aad-a0f0-25292fdd8ebc tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Returning 404 to user: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:40:44 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a8075e18-c35d-4aad-a0f0-25292fdd8ebc tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2" status: 404 len: 111 microversion: 2.32 time: 0.048682 Apr 14 15:40:44 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 93/285] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:40:44 2023] GET /compute/v2.1/servers/02f5b99c-b3e0-4601-be25-1c3053d76ef2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:40:45 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-unplugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}, {"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-plugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:45 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] Creating event network-vif-unplugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:40:45 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] Creating event network-vif-plugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:40:45 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.046743 Apr 14 15:40:45 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 96/286] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:45 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:45 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-plugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}, {"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-plugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:45 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] Creating event network-vif-plugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:40:45 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] Creating event network-vif-plugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:40:45 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038505 Apr 14 15:40:45 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 98/287] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:49 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-18503942-10b9-45b4-bfc8-9e1adc7edde1 req-ae208edb-8e38-41c9-b598-a6a895855261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-plugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-18503942-10b9-45b4-bfc8-9e1adc7edde1 req-ae208edb-8e38-41c9-b598-a6a895855261 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-18503942-10b9-45b4-bfc8-9e1adc7edde1 req-ae208edb-8e38-41c9-b598-a6a895855261 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-18503942-10b9-45b4-bfc8-9e1adc7edde1 req-ae208edb-8e38-41c9-b598-a6a895855261 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-18503942-10b9-45b4-bfc8-9e1adc7edde1 req-ae208edb-8e38-41c9-b598-a6a895855261 service nova] Creating event network-vif-plugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:40:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-18503942-10b9-45b4-bfc8-9e1adc7edde1 req-ae208edb-8e38-41c9-b598-a6a895855261 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033862 Apr 14 15:40:49 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 94/288] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:51 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-ff67024c-babb-4ff9-ac52-38c27d9a4753 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Action: 'create', calling method: .version_select at 0x7f2970cc0d30>, body: {"keypair": {"name": "tempest-keypair-2131359708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw=="}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:51 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-ff67024c-babb-4ff9-ac52-38c27d9a4753 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for project 95e26fa4727e46479d108fe49e225706. Resources: {'key_pairs'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:40:51 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-ff67024c-babb-4ff9-ac52-38c27d9a4753 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for user 3062186c340a4cfe875d5455b0ace246 and project 95e26fa4727e46479d108fe49e225706. Resources: {'key_pairs'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:40:51 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-ff67024c-babb-4ff9-ac52-38c27d9a4753 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.225988 Apr 14 15:40:51 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 97/289] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 15:40:50 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:51 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-e0930b29-68a1-4d45-94d8-19a2875da9ba req-cb743f75-eb77-49d3-96b0-e454475ff520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-plugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:51 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-e0930b29-68a1-4d45-94d8-19a2875da9ba req-cb743f75-eb77-49d3-96b0-e454475ff520 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:51 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-e0930b29-68a1-4d45-94d8-19a2875da9ba req-cb743f75-eb77-49d3-96b0-e454475ff520 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:51 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-e0930b29-68a1-4d45-94d8-19a2875da9ba req-cb743f75-eb77-49d3-96b0-e454475ff520 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:51 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-e0930b29-68a1-4d45-94d8-19a2875da9ba req-cb743f75-eb77-49d3-96b0-e454475ff520 service nova] Creating event network-vif-plugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:40:51 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-e0930b29-68a1-4d45-94d8-19a2875da9ba req-cb743f75-eb77-49d3-96b0-e454475ff520 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038795 Apr 14 15:40:51 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 99/290] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1856157720", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b5636fab-ff0a-4313-afb7-6f7fa779e363"}], "security_groups": [{"name": "tempest-securitygroup--448801128"}], "key_name": "tempest-keypair-2131359708", "user_data": "}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] validate_networks() for [('b5636fab-ff0a-4313-afb7-6f7fa779e363', None, None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for project 95e26fa4727e46479d108fe49e225706. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for user 3062186c340a4cfe875d5455b0ace246 and project 95e26fa4727e46479d108fe49e225706. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:40:53 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:40:53 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.829890 Apr 14 15:40:53 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 95/291] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:40:53 2023] POST /compute/v2.1/servers => generated 406 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:40:54 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-475e0244-b82b-4114-a5c9-e0f94be046d8 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:54 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-475e0244-b82b-4114-a5c9-e0f94be046d8 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:54 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-475e0244-b82b-4114-a5c9-e0f94be046d8 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-475e0244-b82b-4114-a5c9-e0f94be046d8 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1233 microversion: 2.1 time: 0.183565 Apr 14 15:40:54 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 98/292] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:40:54 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1233 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:40:55 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-0deca64a-77f5-4b6f-b451-6ec90434a08e tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:40:55 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-0deca64a-77f5-4b6f-b451-6ec90434a08e tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:40:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-0deca64a-77f5-4b6f-b451-6ec90434a08e tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-0deca64a-77f5-4b6f-b451-6ec90434a08e tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-0deca64a-77f5-4b6f-b451-6ec90434a08e tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-0deca64a-77f5-4b6f-b451-6ec90434a08e tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-0deca64a-77f5-4b6f-b451-6ec90434a08e tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-0deca64a-77f5-4b6f-b451-6ec90434a08e tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:56 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-0deca64a-77f5-4b6f-b451-6ec90434a08e tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1aa921f86bd4f3b88eb782d5f667816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '029b8c395f264a86933a9e878c18e0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:40:56 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-0deca64a-77f5-4b6f-b451-6ec90434a08e tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32" status: 200 len: 1496 microversion: 2.1 time: 0.352180 Apr 14 15:40:56 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 100/293] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:40:55 2023] GET /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32 => generated 1496 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:40:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:40:57 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:40:57 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:40:57 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:40:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] Creating event network-changed:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:40:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046289 Apr 14 15:40:57 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 96/294] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:40:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:00 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-75154a95-00c5-4410-bf9a-e150faf95f98 req-3df3c110-92c0-4f34-a5c9-6f321f6d21f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-plugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:00 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=10,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:00 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-75154a95-00c5-4410-bf9a-e150faf95f98 req-3df3c110-92c0-4f34-a5c9-6f321f6d21f4 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:00 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-75154a95-00c5-4410-bf9a-e150faf95f98 req-3df3c110-92c0-4f34-a5c9-6f321f6d21f4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:00 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-75154a95-00c5-4410-bf9a-e150faf95f98 req-3df3c110-92c0-4f34-a5c9-6f321f6d21f4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:00 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-75154a95-00c5-4410-bf9a-e150faf95f98 req-3df3c110-92c0-4f34-a5c9-6f321f6d21f4 service nova] Creating event network-vif-plugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:41:00 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-75154a95-00c5-4410-bf9a-e150faf95f98 req-3df3c110-92c0-4f34-a5c9-6f321f6d21f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066483 Apr 14 15:41:00 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 99/295] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:41:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:02 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-02b285d9-7df8-4487-a53a-71bc6c7a0831 req-18bfabd6-fe54-423d-ad9f-7e9c273537e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-plugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-02b285d9-7df8-4487-a53a-71bc6c7a0831 req-18bfabd6-fe54-423d-ad9f-7e9c273537e6 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-02b285d9-7df8-4487-a53a-71bc6c7a0831 req-18bfabd6-fe54-423d-ad9f-7e9c273537e6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-02b285d9-7df8-4487-a53a-71bc6c7a0831 req-18bfabd6-fe54-423d-ad9f-7e9c273537e6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:02 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-02b285d9-7df8-4487-a53a-71bc6c7a0831 req-18bfabd6-fe54-423d-ad9f-7e9c273537e6 service nova] Creating event network-vif-plugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:41:02 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-02b285d9-7df8-4487-a53a-71bc6c7a0831 req-18bfabd6-fe54-423d-ad9f-7e9c273537e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040983 Apr 14 15:41:02 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 101/296] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:41:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-97e72ca4-81c7-4b1e-a7ac-faee670623df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-97e72ca4-81c7-4b1e-a7ac-faee670623df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-97e72ca4-81c7-4b1e-a7ac-faee670623df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-97e72ca4-81c7-4b1e-a7ac-faee670623df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-97e72ca4-81c7-4b1e-a7ac-faee670623df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-97e72ca4-81c7-4b1e-a7ac-faee670623df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-97e72ca4-81c7-4b1e-a7ac-faee670623df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-97e72ca4-81c7-4b1e-a7ac-faee670623df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=20 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:06 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-97e72ca4-81c7-4b1e-a7ac-faee670623df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] HTTP exception thrown: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-97e72ca4-81c7-4b1e-a7ac-faee670623df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Request method failure captured: Apr 14 15:41:06 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 HTTP/1.1 Apr 14 15:41:06 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:41:06 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:41:06 user devstack@n-api.service[61875]: Connection: close Apr 14 15:41:06 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:41:06 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:41:06 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:41:06 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:41:06 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXL95JWLmONfTrhpJmmUWoidh6SxM6nOj4T6nb8eiCzGyQ8xri5QYFuYNhdtZLUHL4oGnJqSuEepZDj66OEbgJzZJeiNKYrkGdM78HBIq2CBd_mG7YSrfK2eef4zoe0o--DIA0Ny5tXerL6dbd4mO3kxcJGCA4XuQGooGSa-qHGlW8A Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Project-Id: 3a8e73ef2ad94e84876def53ddf43da4 Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Project-Name: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Tenant: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Tenant-Id: 3a8e73ef2ad94e84876def53ddf43da4 Apr 14 15:41:06 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:41:06 user devstack@n-api.service[61875]: X-User: tempest-ServersNegativeTestJSON-443911091-project-member Apr 14 15:41:06 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:41:06 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:41:06 user devstack@n-api.service[61875]: X-User-Id: af824b840c604223afd90bce17fe1ceb Apr 14 15:41:06 user devstack@n-api.service[61875]: X-User-Name: tempest-ServersNegativeTestJSON-443911091-project-member Apr 14 15:41:06 user devstack@n-api.service[61875]: method: > Apr 14 15:41:06 user devstack@n-api.service[61875]: exception: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:41:06 user devstack@n-api.service[61875]: action_args: {'id': 'f5f1e2d0-08c5-4f11-b90a-7257a14e4e62'} Apr 14 15:41:06 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:41:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:06 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-97e72ca4-81c7-4b1e-a7ac-faee670623df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Returning 404 to user: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:41:06 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-97e72ca4-81c7-4b1e-a7ac-faee670623df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" status: 404 len: 111 microversion: 2.1 time: 0.040534 Apr 14 15:41:06 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 97/297] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:41:06 2023] GET /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:41:06 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:06 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-cb98fec0-ca9f-479e-a246-8799c3f86d2f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:06 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-cb98fec0-ca9f-479e-a246-8799c3f86d2f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:41:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cb98fec0-ca9f-479e-a246-8799c3f86d2f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cb98fec0-ca9f-479e-a246-8799c3f86d2f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cb98fec0-ca9f-479e-a246-8799c3f86d2f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cb98fec0-ca9f-479e-a246-8799c3f86d2f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cb98fec0-ca9f-479e-a246-8799c3f86d2f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cb98fec0-ca9f-479e-a246-8799c3f86d2f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:06 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-cb98fec0-ca9f-479e-a246-8799c3f86d2f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af824b840c604223afd90bce17fe1ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e73ef2ad94e84876def53ddf43da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:41:06 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-cb98fec0-ca9f-479e-a246-8799c3f86d2f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a" status: 200 len: 1494 microversion: 2.1 time: 0.286495 Apr 14 15:41:06 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 100/298] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:41:06 2023] GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a => generated 1494 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:41:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-13fc6ea1-adf1-45ae-bb45-0b285b67be65 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:16 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-13fc6ea1-adf1-45ae-bb45-0b285b67be65 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:41:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=17 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=29 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-13fc6ea1-adf1-45ae-bb45-0b285b67be65 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-13fc6ea1-adf1-45ae-bb45-0b285b67be65 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-13fc6ea1-adf1-45ae-bb45-0b285b67be65 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-13fc6ea1-adf1-45ae-bb45-0b285b67be65 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-4c117964-12e9-428f-8e74-d5b060705d17 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:16 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-4c117964-12e9-428f-8e74-d5b060705d17 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:41:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-13fc6ea1-adf1-45ae-bb45-0b285b67be65 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-13fc6ea1-adf1-45ae-bb45-0b285b67be65 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4c117964-12e9-428f-8e74-d5b060705d17 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4c117964-12e9-428f-8e74-d5b060705d17 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4c117964-12e9-428f-8e74-d5b060705d17 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4c117964-12e9-428f-8e74-d5b060705d17 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4c117964-12e9-428f-8e74-d5b060705d17 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4c117964-12e9-428f-8e74-d5b060705d17 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-4c117964-12e9-428f-8e74-d5b060705d17 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] HTTP exception thrown: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-4c117964-12e9-428f-8e74-d5b060705d17 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Request method failure captured: Apr 14 15:41:16 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5 HTTP/1.1 Apr 14 15:41:16 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:41:16 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:41:16 user devstack@n-api.service[61875]: Connection: close Apr 14 15:41:16 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:41:16 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:41:16 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:41:16 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:41:16 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXMJjXPLTYWrRufrafTi00OCzbCq0O1IhkHTfIPxOLBPZH2veoG-ubhL5JW16O9DNW4EOT5jQIol9IhrdgY6Ybl6IFmCtelhO2vGtggP6xNTKpZegIqS9ZwPFkDE90L4cGbWGuECQ5gEJplE3tAK7r4aOAxywjqXAoBBcJMSRUZRi2s Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Project-Id: ead92c17f9e64b90adac77a44a473bde Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Project-Name: tempest-TaggedAttachmentsTest-1077829930 Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ead92c17f9e64b90adac77a44a473bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ead92c17f9e64b90adac77a44a473bde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ead92c17f9e64b90adac77a44a473bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Tenant: tempest-TaggedAttachmentsTest-1077829930 Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Tenant-Id: ead92c17f9e64b90adac77a44a473bde Apr 14 15:41:16 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1077829930 Apr 14 15:41:16 user devstack@n-api.service[61875]: X-User: tempest-TaggedAttachmentsTest-1077829930-project-member Apr 14 15:41:16 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:41:16 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:41:16 user devstack@n-api.service[61875]: X-User-Id: 9a5a6a16abaa4c63b0220beb95fc9613 Apr 14 15:41:16 user devstack@n-api.service[61875]: X-User-Name: tempest-TaggedAttachmentsTest-1077829930-project-member Apr 14 15:41:16 user devstack@n-api.service[61875]: method: > Apr 14 15:41:16 user devstack@n-api.service[61875]: exception: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:16 user devstack@n-api.service[61875]: action_args: {'id': '112ffb8d-fef8-4ffd-991c-626c7e4c85b5'} Apr 14 15:41:16 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:16 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-4c117964-12e9-428f-8e74-d5b060705d17 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Returning 404 to user: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:41:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-4c117964-12e9-428f-8e74-d5b060705d17 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5" status: 404 len: 111 microversion: 2.49 time: 0.033900 Apr 14 15:41:16 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 98/299] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:41:16 2023] GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:41:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-d2bd7bf3-67ca-4916-81e1-ac778f4eae57 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Calling method '.version_select at 0x7f2970cc32e0>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:16 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:16 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-d2bd7bf3-67ca-4916-81e1-ac778f4eae57 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198337819" status: 204 len: 0 microversion: 2.49 time: 0.037712 Apr 14 15:41:16 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 101/300] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 15:41:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198337819 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 15:41:16 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-13fc6ea1-adf1-45ae-bb45-0b285b67be65 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:41:16 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-13fc6ea1-adf1-45ae-bb45-0b285b67be65 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:41:16 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-13fc6ea1-adf1-45ae-bb45-0b285b67be65 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:41:16 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-13fc6ea1-adf1-45ae-bb45-0b285b67be65 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" status: 200 len: 1768 microversion: 2.87 time: 0.375648 Apr 14 15:41:16 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 102/301] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:41:16 2023] GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => generated 1768 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:41:19 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b205f4da-d53c-42de-bdd7-0686501a3622 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:19 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-b205f4da-d53c-42de-bdd7-0686501a3622 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:41:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b205f4da-d53c-42de-bdd7-0686501a3622 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b205f4da-d53c-42de-bdd7-0686501a3622 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b205f4da-d53c-42de-bdd7-0686501a3622 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b205f4da-d53c-42de-bdd7-0686501a3622 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b205f4da-d53c-42de-bdd7-0686501a3622 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b205f4da-d53c-42de-bdd7-0686501a3622 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:19 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-b205f4da-d53c-42de-bdd7-0686501a3622 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] HTTP exception thrown: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:19 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b205f4da-d53c-42de-bdd7-0686501a3622 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Request method failure captured: Apr 14 15:41:19 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5 HTTP/1.1 Apr 14 15:41:19 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:41:19 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:41:19 user devstack@n-api.service[61875]: Connection: close Apr 14 15:41:19 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:41:19 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:41:19 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:41:19 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:41:19 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXMJjXPLTYWrRufrafTi00OCzbCq0O1IhkHTfIPxOLBPZH2veoG-ubhL5JW16O9DNW4EOT5jQIol9IhrdgY6Ybl6IFmCtelhO2vGtggP6xNTKpZegIqS9ZwPFkDE90L4cGbWGuECQ5gEJplE3tAK7r4aOAxywjqXAoBBcJMSRUZRi2s Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Project-Id: ead92c17f9e64b90adac77a44a473bde Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Project-Name: tempest-TaggedAttachmentsTest-1077829930 Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ead92c17f9e64b90adac77a44a473bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ead92c17f9e64b90adac77a44a473bde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ead92c17f9e64b90adac77a44a473bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Tenant: tempest-TaggedAttachmentsTest-1077829930 Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Tenant-Id: ead92c17f9e64b90adac77a44a473bde Apr 14 15:41:19 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1077829930 Apr 14 15:41:19 user devstack@n-api.service[61875]: X-User: tempest-TaggedAttachmentsTest-1077829930-project-member Apr 14 15:41:19 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:41:19 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:41:19 user devstack@n-api.service[61875]: X-User-Id: 9a5a6a16abaa4c63b0220beb95fc9613 Apr 14 15:41:19 user devstack@n-api.service[61875]: X-User-Name: tempest-TaggedAttachmentsTest-1077829930-project-member Apr 14 15:41:19 user devstack@n-api.service[61875]: method: > Apr 14 15:41:19 user devstack@n-api.service[61875]: exception: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:19 user devstack@n-api.service[61875]: action_args: {'id': '112ffb8d-fef8-4ffd-991c-626c7e4c85b5'} Apr 14 15:41:19 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:19 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:19 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b205f4da-d53c-42de-bdd7-0686501a3622 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Returning 404 to user: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:41:19 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-b205f4da-d53c-42de-bdd7-0686501a3622 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5" status: 404 len: 111 microversion: 2.49 time: 0.031130 Apr 14 15:41:19 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 99/302] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 15:41:19 2023] DELETE /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:41:19 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=8 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:19 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-fd86d8a9-5918-4f31-9f3d-ed1cc918d727 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:19 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-fd86d8a9-5918-4f31-9f3d-ed1cc918d727 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:41:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fd86d8a9-5918-4f31-9f3d-ed1cc918d727 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fd86d8a9-5918-4f31-9f3d-ed1cc918d727 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fd86d8a9-5918-4f31-9f3d-ed1cc918d727 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fd86d8a9-5918-4f31-9f3d-ed1cc918d727 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fd86d8a9-5918-4f31-9f3d-ed1cc918d727 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fd86d8a9-5918-4f31-9f3d-ed1cc918d727 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:19 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-fd86d8a9-5918-4f31-9f3d-ed1cc918d727 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] HTTP exception thrown: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:19 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-fd86d8a9-5918-4f31-9f3d-ed1cc918d727 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Request method failure captured: Apr 14 15:41:19 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5 HTTP/1.1 Apr 14 15:41:19 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:41:19 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:41:19 user devstack@n-api.service[61874]: Connection: close Apr 14 15:41:19 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:41:19 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:41:19 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:41:19 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:41:19 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXMJjXPLTYWrRufrafTi00OCzbCq0O1IhkHTfIPxOLBPZH2veoG-ubhL5JW16O9DNW4EOT5jQIol9IhrdgY6Ybl6IFmCtelhO2vGtggP6xNTKpZegIqS9ZwPFkDE90L4cGbWGuECQ5gEJplE3tAK7r4aOAxywjqXAoBBcJMSRUZRi2s Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Project-Id: ead92c17f9e64b90adac77a44a473bde Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Project-Name: tempest-TaggedAttachmentsTest-1077829930 Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ead92c17f9e64b90adac77a44a473bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ead92c17f9e64b90adac77a44a473bde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ead92c17f9e64b90adac77a44a473bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Tenant: tempest-TaggedAttachmentsTest-1077829930 Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Tenant-Id: ead92c17f9e64b90adac77a44a473bde Apr 14 15:41:19 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1077829930 Apr 14 15:41:19 user devstack@n-api.service[61874]: X-User: tempest-TaggedAttachmentsTest-1077829930-project-member Apr 14 15:41:19 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:41:19 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:41:19 user devstack@n-api.service[61874]: X-User-Id: 9a5a6a16abaa4c63b0220beb95fc9613 Apr 14 15:41:19 user devstack@n-api.service[61874]: X-User-Name: tempest-TaggedAttachmentsTest-1077829930-project-member Apr 14 15:41:19 user devstack@n-api.service[61874]: method: > Apr 14 15:41:19 user devstack@n-api.service[61874]: exception: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:19 user devstack@n-api.service[61874]: action_args: {'id': '112ffb8d-fef8-4ffd-991c-626c7e4c85b5'} Apr 14 15:41:19 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. Apr 14 15:41:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:19 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-fd86d8a9-5918-4f31-9f3d-ed1cc918d727 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Returning 404 to user: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:41:19 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-fd86d8a9-5918-4f31-9f3d-ed1cc918d727 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5" status: 404 len: 111 microversion: 2.49 time: 0.048815 Apr 14 15:41:19 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 102/303] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:41:19 2023] GET /compute/v2.1/servers/112ffb8d-fef8-4ffd-991c-626c7e4c85b5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:41:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-1f3109e9-eecf-49c3-9da3-888541099b2f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Action: 'create', calling method: .version_select at 0x7f29709423b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1176689891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6qHHx+CxaN6D4OE7uOO+Zw9h265eOOsY49enaOyamUK510/z5PjCK1XCp54E7Fnoenf98jTQR5OBhbEdD1bW89dU7GYsg+IZ1bquAjdx3vSGtcm2Tq01+SPNh6cUaujw=="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:28 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-1f3109e9-eecf-49c3-9da3-888541099b2f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting quotas for project 6d21cbc9fcc74fdd8579bad00a8ba2eb. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:41:28 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-1f3109e9-eecf-49c3-9da3-888541099b2f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting quotas for user 4e5d615d61ea4b1dafa4207d7b21e2d5 and project 6d21cbc9fcc74fdd8579bad00a8ba2eb. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:41:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-1f3109e9-eecf-49c3-9da3-888541099b2f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053182 Apr 14 15:41:28 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 103/304] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 15:41:28 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1381069102", "imageRef": "07f87bf5-ccf2-4c81-8d43-c1a9d8492556", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1176689891", "networks": [{"uuid": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4"}]}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] validate_networks() for [('ccc6a426-f548-4d9b-b4d1-89934ac80cf4', None, None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=5 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting quotas for project 6d21cbc9fcc74fdd8579bad00a8ba2eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting quotas for user 4e5d615d61ea4b1dafa4207d7b21e2d5 and project 6d21cbc9fcc74fdd8579bad00a8ba2eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:41:29 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07f87bf5-ccf2-4c81-8d43-c1a9d8492556',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:41:29 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.895980 Apr 14 15:41:29 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 100/305] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:41:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:41:29 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-521dd11f-9ed7-49ce-a5c3-5b82bf838432 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:29 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-521dd11f-9ed7-49ce-a5c3-5b82bf838432 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:41:29 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:29 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:30 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-521dd11f-9ed7-49ce-a5c3-5b82bf838432 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:41:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-521dd11f-9ed7-49ce-a5c3-5b82bf838432 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36" status: 200 len: 1253 microversion: 2.1 time: 0.119647 Apr 14 15:41:30 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 103/306] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:41:29 2023] GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36 => generated 1253 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:41:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:31 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:41:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:31 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'flavor' on Instance uuid 0f27f459-5b11-4564-ab4c-7194b18319f4 {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:41:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4/action" status: 200 len: 32 microversion: 2.1 time: 0.162140 Apr 14 15:41:31 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 104/307] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:41:31 2023] POST /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:41:31 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bd435962-9b9a-4b64-8cf7-9780cf9a6f82 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:31 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-bd435962-9b9a-4b64-8cf7-9780cf9a6f82 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:41:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bd435962-9b9a-4b64-8cf7-9780cf9a6f82 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bd435962-9b9a-4b64-8cf7-9780cf9a6f82 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bd435962-9b9a-4b64-8cf7-9780cf9a6f82 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bd435962-9b9a-4b64-8cf7-9780cf9a6f82 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bd435962-9b9a-4b64-8cf7-9780cf9a6f82 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bd435962-9b9a-4b64-8cf7-9780cf9a6f82 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:31 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-bc5faf53-902f-4ddc-9546-ef26f6701478 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:31 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-bc5faf53-902f-4ddc-9546-ef26f6701478 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:41:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bc5faf53-902f-4ddc-9546-ef26f6701478 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bc5faf53-902f-4ddc-9546-ef26f6701478 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bc5faf53-902f-4ddc-9546-ef26f6701478 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bc5faf53-902f-4ddc-9546-ef26f6701478 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bc5faf53-902f-4ddc-9546-ef26f6701478 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bc5faf53-902f-4ddc-9546-ef26f6701478 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:31 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-bc5faf53-902f-4ddc-9546-ef26f6701478 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] HTTP exception thrown: Instance 31b57881-e95e-41d5-9f78-61d95ecfd93a could not be found. Apr 14 15:41:31 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-bc5faf53-902f-4ddc-9546-ef26f6701478 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Request method failure captured: Apr 14 15:41:31 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a HTTP/1.1 Apr 14 15:41:31 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:41:31 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:41:31 user devstack@n-api.service[61874]: Connection: close Apr 14 15:41:31 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:41:31 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:41:31 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:41:31 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:41:31 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXMAHO1rpVrGhoETNRF61Tz8pokGaXvzLAF5bcluJNzd18nlfALzMMbZQ9lg6o_1sfxjIFf10YavR1fTpUBGYOHnqAuckDhp7OF81N5A0uAVUBgLH14UPW1qulRkJ7KvliIVsjvytJiArtGYtc70MeAB6jarwROzSTadTCB0mkRqGSE Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Project-Id: f84eb038f3914d54a892a6dabdf6f67b Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Project-Name: tempest-TestVolumeSwap-914090000 Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f84eb038f3914d54a892a6dabdf6f67b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f84eb038f3914d54a892a6dabdf6f67b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f84eb038f3914d54a892a6dabdf6f67b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Tenant: tempest-TestVolumeSwap-914090000 Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Tenant-Id: f84eb038f3914d54a892a6dabdf6f67b Apr 14 15:41:31 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-TestVolumeSwap-914090000 Apr 14 15:41:31 user devstack@n-api.service[61874]: X-User: tempest-TestVolumeSwap-914090000-project-member Apr 14 15:41:31 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:41:31 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:41:31 user devstack@n-api.service[61874]: X-User-Id: 8903273cb7ea4a0c9831dbcc74361ae2 Apr 14 15:41:31 user devstack@n-api.service[61874]: X-User-Name: tempest-TestVolumeSwap-914090000-project-member Apr 14 15:41:31 user devstack@n-api.service[61874]: method: > Apr 14 15:41:31 user devstack@n-api.service[61874]: exception: Instance 31b57881-e95e-41d5-9f78-61d95ecfd93a could not be found. Apr 14 15:41:31 user devstack@n-api.service[61874]: action_args: {'id': '31b57881-e95e-41d5-9f78-61d95ecfd93a'} Apr 14 15:41:31 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b57881-e95e-41d5-9f78-61d95ecfd93a could not be found. Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b57881-e95e-41d5-9f78-61d95ecfd93a could not be found. Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b57881-e95e-41d5-9f78-61d95ecfd93a could not be found. Apr 14 15:41:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:31 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-bc5faf53-902f-4ddc-9546-ef26f6701478 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Returning 404 to user: Instance 31b57881-e95e-41d5-9f78-61d95ecfd93a could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:41:31 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-bc5faf53-902f-4ddc-9546-ef26f6701478 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a" status: 404 len: 111 microversion: 2.1 time: 0.106365 Apr 14 15:41:31 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 104/308] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:41:31 2023] GET /compute/v2.1/servers/31b57881-e95e-41d5-9f78-61d95ecfd93a => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:41:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-fa34a419-13b9-41c6-b9d8-9470c84162b6 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Calling method '.version_select at 0x7f2970bb5ab0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-fa34a419-13b9-41c6-b9d8-9470c84162b6 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390268231" status: 202 len: 0 microversion: 2.1 time: 0.047297 Apr 14 15:41:31 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 105/309] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 15:41:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390268231 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:41:32 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-bd435962-9b9a-4b64-8cf7-9780cf9a6f82 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:41:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-bd435962-9b9a-4b64-8cf7-9780cf9a6f82 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4" status: 200 len: 1508 microversion: 2.1 time: 0.823436 Apr 14 15:41:32 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 101/310] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:41:31 2023] GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4 => generated 1508 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:41:33 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-40b39191-f1c8-4fe6-9461-e8f5a342a9a3 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Action: 'create', calling method: .version_select at 0x7f2970b7a290>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1196700447", "metadata": {"Type": "work"}}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:33 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-92fafa12-22ca-4871-873d-b4747b82b558 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:33 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-92fafa12-22ca-4871-873d-b4747b82b558 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:41:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-92fafa12-22ca-4871-873d-b4747b82b558 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-92fafa12-22ca-4871-873d-b4747b82b558 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-92fafa12-22ca-4871-873d-b4747b82b558 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-92fafa12-22ca-4871-873d-b4747b82b558 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-92fafa12-22ca-4871-873d-b4747b82b558 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-92fafa12-22ca-4871-873d-b4747b82b558 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:33 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-b976f0a2-2d54-4d46-8a5f-65fb2b2bcf6b req-85827bcd-6923-47a2-a842-ea199a23e66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "name": "network-vif-unplugged", "status": "completed", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-b976f0a2-2d54-4d46-8a5f-65fb2b2bcf6b req-85827bcd-6923-47a2-a842-ea199a23e66e service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-b976f0a2-2d54-4d46-8a5f-65fb2b2bcf6b req-85827bcd-6923-47a2-a842-ea199a23e66e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-b976f0a2-2d54-4d46-8a5f-65fb2b2bcf6b req-85827bcd-6923-47a2-a842-ea199a23e66e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:33 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-b976f0a2-2d54-4d46-8a5f-65fb2b2bcf6b req-85827bcd-6923-47a2-a842-ea199a23e66e service nova] Creating event network-vif-unplugged:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:41:33 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-b976f0a2-2d54-4d46-8a5f-65fb2b2bcf6b req-85827bcd-6923-47a2-a842-ea199a23e66e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075190 Apr 14 15:41:33 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 102/311] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:41:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-40b39191-f1c8-4fe6-9461-e8f5a342a9a3 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.024888 Apr 14 15:41:34 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 105/312] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 15:41:33 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 1027 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 15:41:34 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-9ba429c6-c89c-4556-bed0-dec7561b0cff tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Calling method '.version_select at 0x7f2970a46830>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:34 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-9ba429c6-c89c-4556-bed0-dec7561b0cff tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280" status: 200 len: 353 microversion: 2.1 time: 0.118041 Apr 14 15:41:34 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 103/313] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:41:34 2023] GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:34 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-92fafa12-22ca-4871-873d-b4747b82b558 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f805db20d87d4429981c975ebd88ed92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8230c5386464f288fd783b3c60536b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:41:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-92fafa12-22ca-4871-873d-b4747b82b558 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed" status: 200 len: 1701 microversion: 2.1 time: 1.051929 Apr 14 15:41:34 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 106/314] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:41:33 2023] GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed => generated 1701 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:41:35 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-00de365c-be15-406f-87fa-6c71d4ccfb59 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Calling method '.version_select at 0x7f2970b79090>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:35 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-00de365c-be15-406f-87fa-6c71d4ccfb59 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280" status: 200 len: 353 microversion: 2.1 time: 0.106317 Apr 14 15:41:35 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 106/315] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:41:35 2023] GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:35 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}, {"server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "name": "network-vif-plugged", "status": "completed", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] Creating event network-changed:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:41:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] Creating event network-vif-plugged:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:41:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.057857 Apr 14 15:41:35 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 104/316] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:41:35 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:36 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-62ddb96a-e93d-46d1-b987-c3e795c9a860 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Calling method '.version_select at 0x7f2970943370>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:36 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-62ddb96a-e93d-46d1-b987-c3e795c9a860 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280" status: 200 len: 353 microversion: 2.1 time: 0.097430 Apr 14 15:41:36 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 107/317] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:41:36 2023] GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:37 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-8e840ee9-4279-4c01-a466-1f8fc4586080 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Calling method '.version_select at 0x7f2970b789d0>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-8e840ee9-4279-4c01-a466-1f8fc4586080 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280" status: 200 len: 353 microversion: 2.1 time: 0.075202 Apr 14 15:41:37 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 107/318] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:41:37 2023] GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:38 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "name": "network-vif-plugged", "status": "completed", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}, {"server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "name": "network-vif-plugged", "status": "completed", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:38 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] Creating event network-vif-plugged:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:41:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] Creating event network-vif-plugged:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:41:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049651 Apr 14 15:41:38 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 105/319] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:41:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:38 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-f05e246c-2ce4-4e3f-818d-aaa08a7b5826 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Calling method '.version_select at 0x7f2970bb7f40>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:38 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-9178df11-31a1-4615-b16f-1d3a6e262710 req-3f84e9e8-32b5-48b9-8752-079717398c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "name": "network-vif-plugged", "status": "completed", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9178df11-31a1-4615-b16f-1d3a6e262710 req-3f84e9e8-32b5-48b9-8752-079717398c68 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9178df11-31a1-4615-b16f-1d3a6e262710 req-3f84e9e8-32b5-48b9-8752-079717398c68 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9178df11-31a1-4615-b16f-1d3a6e262710 req-3f84e9e8-32b5-48b9-8752-079717398c68 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:38 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:38 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-f05e246c-2ce4-4e3f-818d-aaa08a7b5826 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280" status: 200 len: 354 microversion: 2.1 time: 0.120564 Apr 14 15:41:38 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 108/320] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:41:38 2023] GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:38 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-67ce9daf-0bc8-4e83-94f3-6376fc7c2519 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Calling method '.version_select at 0x7f2970a45630>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:38 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-9178df11-31a1-4615-b16f-1d3a6e262710 req-3f84e9e8-32b5-48b9-8752-079717398c68 service nova] Creating event network-vif-plugged:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:41:38 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-9178df11-31a1-4615-b16f-1d3a6e262710 req-3f84e9e8-32b5-48b9-8752-079717398c68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117605 Apr 14 15:41:38 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 108/321] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:41:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:39 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-67ce9daf-0bc8-4e83-94f3-6376fc7c2519 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280" status: 200 len: 354 microversion: 2.1 time: 0.089358 Apr 14 15:41:39 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 106/322] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:41:38 2023] GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:39 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-d43f189a-62e6-4a6f-857d-7dcf35c58101 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Calling method '.version_select at 0x7f2970943010>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:39 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-d43f189a-62e6-4a6f-857d-7dcf35c58101 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280" status: 202 len: 0 microversion: 2.1 time: 0.146894 Apr 14 15:41:39 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 109/323] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 15:41:39 2023] DELETE /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:41:39 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-65ec8291-c0c0-4285-8067-4b0eb600f2b8 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Calling method '.version_select at 0x7f2970b7ab90>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:39 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-65ec8291-c0c0-4285-8067-4b0eb600f2b8 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280" status: 200 len: 353 microversion: 2.1 time: 0.086290 Apr 14 15:41:39 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 109/324] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:41:39 2023] GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:40 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:40 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:40 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-4cf8275b-c82e-40fe-adf7-64f676b20099 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Calling method '.version_select at 0x7f2970a897e0>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-4cf8275b-c82e-40fe-adf7-64f676b20099 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280" status: 200 len: 353 microversion: 2.1 time: 0.086180 Apr 14 15:41:40 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 107/325] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:41:40 2023] GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:40 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-129bf4d1-5092-4a3c-bd5a-272507054dac req-7782fe1b-5354-4c4e-a3c3-ede539de5a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "name": "network-vif-plugged", "status": "completed", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-129bf4d1-5092-4a3c-bd5a-272507054dac req-7782fe1b-5354-4c4e-a3c3-ede539de5a5e service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-129bf4d1-5092-4a3c-bd5a-272507054dac req-7782fe1b-5354-4c4e-a3c3-ede539de5a5e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-129bf4d1-5092-4a3c-bd5a-272507054dac req-7782fe1b-5354-4c4e-a3c3-ede539de5a5e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-129bf4d1-5092-4a3c-bd5a-272507054dac req-7782fe1b-5354-4c4e-a3c3-ede539de5a5e service nova] Creating event network-vif-plugged:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:41:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-129bf4d1-5092-4a3c-bd5a-272507054dac req-7782fe1b-5354-4c4e-a3c3-ede539de5a5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124336 Apr 14 15:41:41 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 110/326] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:41:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:41 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-dd00abd5-84c8-456c-96c2-ac8363337b1a tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Calling method '.version_select at 0x7f2970b791b0>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:41 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-dd00abd5-84c8-456c-96c2-ac8363337b1a tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280" status: 200 len: 353 microversion: 2.1 time: 0.066137 Apr 14 15:41:41 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 110/327] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:41:41 2023] GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:42 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a75cb604-2cc5-4ca2-8914-b049454618dc tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Calling method '.version_select at 0x7f2970a47490>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:42 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a75cb604-2cc5-4ca2-8914-b049454618dc tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280" status: 200 len: 353 microversion: 2.1 time: 0.066594 Apr 14 15:41:42 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 108/328] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:41:42 2023] GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:41:43 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-99982d38-b505-46ac-8637-82bb35985407 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Calling method '.version_select at 0x7f29709409d0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:43 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-99982d38-b505-46ac-8637-82bb35985407 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] HTTP exception thrown: Volume 4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 could not be found. Apr 14 15:41:43 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-99982d38-b505-46ac-8637-82bb35985407 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Request method failure captured: Apr 14 15:41:43 user devstack@n-api.service[61876]: request: GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 HTTP/1.1 Apr 14 15:41:43 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:41:43 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:41:43 user devstack@n-api.service[61876]: Connection: close Apr 14 15:41:43 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:41:43 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:41:43 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:41:43 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:41:43 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXQtNoFFVKflwbPG3HdVlorY37ENIVufzfbrx7UTqm9LAB-AnIy-c9aM6lUmKg8k454Ys5te7W0yWc9D4fPph5dXUU0uVM0E4Ie4j_fOeBRXQeOVPpvDeAZTZIIJHTsGdphwoFd1v7CXZlRsa-I66RRVyztKB0fEmyvHNZDeWkXcLZ8 Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Project-Id: acadc46990954d05b04533e466d71e34 Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Project-Name: tempest-VolumesGetTestJSON-598361014 Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/acadc46990954d05b04533e466d71e34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acadc46990954d05b04533e466d71e34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/acadc46990954d05b04533e466d71e34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Tenant: tempest-VolumesGetTestJSON-598361014 Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Tenant-Id: acadc46990954d05b04533e466d71e34 Apr 14 15:41:43 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-VolumesGetTestJSON-598361014 Apr 14 15:41:43 user devstack@n-api.service[61876]: X-User: tempest-VolumesGetTestJSON-598361014-project-member Apr 14 15:41:43 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:41:43 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:41:43 user devstack@n-api.service[61876]: X-User-Id: 86317a794d4b4e118e89d38693e25142 Apr 14 15:41:43 user devstack@n-api.service[61876]: X-User-Name: tempest-VolumesGetTestJSON-598361014-project-member Apr 14 15:41:43 user devstack@n-api.service[61876]: method: Apr 14 15:41:43 user devstack@n-api.service[61876]: exception: Volume 4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 could not be found. Apr 14 15:41:43 user devstack@n-api.service[61876]: action_args: {'id': '4da7b3fb-4887-42ca-a1cd-4d59a2ec8280'} Apr 14 15:41:43 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 could not be found. (HTTP 404) (Request-ID: req-d57d44e1-ea14-47d0-9c26-e230d7c8319f) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 could not be found. Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 could not be found. Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 could not be found. Apr 14 15:41:43 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:43 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-99982d38-b505-46ac-8637-82bb35985407 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] Returning 404 to user: Volume 4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:41:43 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-99982d38-b505-46ac-8637-82bb35985407 tempest-VolumesGetTestJSON-598361014 tempest-VolumesGetTestJSON-598361014-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280" status: 404 len: 109 microversion: 2.1 time: 0.084162 Apr 14 15:41:43 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 111/329] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:41:43 2023] GET /compute/v2.1/os-volumes/4da7b3fb-4887-42ca-a1cd-4d59a2ec8280 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:41:44 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-f1fd33d2-5386-4af1-ac26-698f79683046 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:44 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-f1fd33d2-5386-4af1-ac26-698f79683046 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:41:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f1fd33d2-5386-4af1-ac26-698f79683046 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f1fd33d2-5386-4af1-ac26-698f79683046 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f1fd33d2-5386-4af1-ac26-698f79683046 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f1fd33d2-5386-4af1-ac26-698f79683046 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f1fd33d2-5386-4af1-ac26-698f79683046 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f1fd33d2-5386-4af1-ac26-698f79683046 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:44 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-f1fd33d2-5386-4af1-ac26-698f79683046 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:41:44 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-f1fd33d2-5386-4af1-ac26-698f79683046 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1539 microversion: 2.1 time: 0.300216 Apr 14 15:41:44 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 111/330] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:41:44 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1539 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:41:56 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=14 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:56 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-8e3ddc6a-bb21-46a1-a715-142f301c0d94 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Action: 'create', calling method: .version_select at 0x7f2970a88670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1235704517", "metadata": {"Type": "work"}}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-8e3ddc6a-bb21-46a1-a715-142f301c0d94 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Request method failure captured: Apr 14 15:41:57 user devstack@n-api.service[61875]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 15:41:57 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:41:57 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:41:57 user devstack@n-api.service[61875]: Connection: close Apr 14 15:41:57 user devstack@n-api.service[61875]: Content-Length: 122 Apr 14 15:41:57 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:41:57 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:41:57 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:41:57 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXREcR4rugSZgkc4qq78oazBDQajk9tKbccL3OQuRCxxHu5wTYKco4Z0l81K4rn5iuKm4zHe8txndd-Z6aj_VdADk5E-0tiBJ18Rn9IAxtU0rIvBb6r3A31m4ZwiSuqYp26sIXiFQk5InNt5RRE_i-fISxN5st5JQJewJ0YXAU49jRQ Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Project-Id: b3ca8e495bcf48ba87a799c47a98a543 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Project-Name: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Tenant: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Tenant-Id: b3ca8e495bcf48ba87a799c47a98a543 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User: tempest-VolumesNegativeTest-1671649469-project-member Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User-Id: 5936cb42ca914307b098fc866376c516 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User-Name: tempest-VolumesNegativeTest-1671649469-project-member Apr 14 15:41:57 user devstack@n-api.service[61875]: Apr 14 15:41:57 user devstack@n-api.service[61875]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1235704517", "metadata": {"Type": "work"}}} Apr 14 15:41:57 user devstack@n-api.service[61875]: method: Apr 14 15:41:57 user devstack@n-api.service[61875]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 15:41:57 user devstack@n-api.service[61875]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1235704517', 'metadata': {'Type': 'work'}}}} Apr 14 15:41:57 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise error Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi '#$%' Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-8e3ddc6a-bb21-46a1-a715-142f301c0d94 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:41:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-8e3ddc6a-bb21-46a1-a715-142f301c0d94 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.323822 Apr 14 15:41:57 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 109/331] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 15:41:56 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 325 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:41:57 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:57 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:57 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-44e16b41-1502-4eb0-bf78-f1a6f9d09301 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Action: 'create', calling method: .version_select at 0x7f2970bb43a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-502780256", "metadata": {"Type": "work"}}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:57 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-44e16b41-1502-4eb0-bf78-f1a6f9d09301 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Request method failure captured: Apr 14 15:41:57 user devstack@n-api.service[61876]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 15:41:57 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:41:57 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:41:57 user devstack@n-api.service[61876]: Connection: close Apr 14 15:41:57 user devstack@n-api.service[61876]: Content-Length: 119 Apr 14 15:41:57 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:41:57 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:41:57 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:41:57 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXREcR4rugSZgkc4qq78oazBDQajk9tKbccL3OQuRCxxHu5wTYKco4Z0l81K4rn5iuKm4zHe8txndd-Z6aj_VdADk5E-0tiBJ18Rn9IAxtU0rIvBb6r3A31m4ZwiSuqYp26sIXiFQk5InNt5RRE_i-fISxN5st5JQJewJ0YXAU49jRQ Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Project-Id: b3ca8e495bcf48ba87a799c47a98a543 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Project-Name: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Tenant: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Tenant-Id: b3ca8e495bcf48ba87a799c47a98a543 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-User: tempest-VolumesNegativeTest-1671649469-project-member Apr 14 15:41:57 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:41:57 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:41:57 user devstack@n-api.service[61876]: X-User-Id: 5936cb42ca914307b098fc866376c516 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-User-Name: tempest-VolumesNegativeTest-1671649469-project-member Apr 14 15:41:57 user devstack@n-api.service[61876]: Apr 14 15:41:57 user devstack@n-api.service[61876]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-502780256", "metadata": {"Type": "work"}}} Apr 14 15:41:57 user devstack@n-api.service[61876]: method: Apr 14 15:41:57 user devstack@n-api.service[61876]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 15:41:57 user devstack@n-api.service[61876]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-502780256', 'metadata': {'Type': 'work'}}}} Apr 14 15:41:57 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise error Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi '0' Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-44e16b41-1502-4eb0-bf78-f1a6f9d09301 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:41:57 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-44e16b41-1502-4eb0-bf78-f1a6f9d09301 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017369 Apr 14 15:41:57 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 112/332] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 15:41:57 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:41:57 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=10 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:57 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=10 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:41:57 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-94bbbeef-579e-4263-979b-4e5bcc471bc4 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Action: 'create', calling method: .version_select at 0x7f2970b7af80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-348495673", "metadata": {"Type": "work"}}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:57 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-94bbbeef-579e-4263-979b-4e5bcc471bc4 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Request method failure captured: Apr 14 15:41:57 user devstack@n-api.service[61874]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 15:41:57 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:41:57 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:41:57 user devstack@n-api.service[61874]: Connection: close Apr 14 15:41:57 user devstack@n-api.service[61874]: Content-Length: 118 Apr 14 15:41:57 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:41:57 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:41:57 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:41:57 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXREcR4rugSZgkc4qq78oazBDQajk9tKbccL3OQuRCxxHu5wTYKco4Z0l81K4rn5iuKm4zHe8txndd-Z6aj_VdADk5E-0tiBJ18Rn9IAxtU0rIvBb6r3A31m4ZwiSuqYp26sIXiFQk5InNt5RRE_i-fISxN5st5JQJewJ0YXAU49jRQ Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Project-Id: b3ca8e495bcf48ba87a799c47a98a543 Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Project-Name: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Tenant: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Tenant-Id: b3ca8e495bcf48ba87a799c47a98a543 Apr 14 15:41:57 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61874]: X-User: tempest-VolumesNegativeTest-1671649469-project-member Apr 14 15:41:57 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:41:57 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:41:57 user devstack@n-api.service[61874]: X-User-Id: 5936cb42ca914307b098fc866376c516 Apr 14 15:41:57 user devstack@n-api.service[61874]: X-User-Name: tempest-VolumesNegativeTest-1671649469-project-member Apr 14 15:41:57 user devstack@n-api.service[61874]: Apr 14 15:41:57 user devstack@n-api.service[61874]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-348495673", "metadata": {"Type": "work"}}} Apr 14 15:41:57 user devstack@n-api.service[61874]: method: Apr 14 15:41:57 user devstack@n-api.service[61874]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 15:41:57 user devstack@n-api.service[61874]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-348495673', 'metadata': {'Type': 'work'}}}} Apr 14 15:41:57 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise error Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi '' Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 15:41:57 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-94bbbeef-579e-4263-979b-4e5bcc471bc4 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:41:57 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-94bbbeef-579e-4263-979b-4e5bcc471bc4 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015190 Apr 14 15:41:57 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 112/333] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 15:41:57 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:41:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-7b7e00ba-9457-43ad-b491-4b2a37ef2f43 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Calling method '.version_select at 0x7f2970a8a170>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-7b7e00ba-9457-43ad-b491-4b2a37ef2f43 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] HTTP exception thrown: Volume tempest-invalid-1540503349 could not be found. Apr 14 15:41:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-7b7e00ba-9457-43ad-b491-4b2a37ef2f43 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Request method failure captured: Apr 14 15:41:57 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1540503349 HTTP/1.1 Apr 14 15:41:57 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:41:57 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:41:57 user devstack@n-api.service[61875]: Connection: close Apr 14 15:41:57 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:41:57 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:41:57 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:41:57 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:41:57 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXREcR4rugSZgkc4qq78oazBDQajk9tKbccL3OQuRCxxHu5wTYKco4Z0l81K4rn5iuKm4zHe8txndd-Z6aj_VdADk5E-0tiBJ18Rn9IAxtU0rIvBb6r3A31m4ZwiSuqYp26sIXiFQk5InNt5RRE_i-fISxN5st5JQJewJ0YXAU49jRQ Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Project-Id: b3ca8e495bcf48ba87a799c47a98a543 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Project-Name: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Tenant: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Tenant-Id: b3ca8e495bcf48ba87a799c47a98a543 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User: tempest-VolumesNegativeTest-1671649469-project-member Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User-Id: 5936cb42ca914307b098fc866376c516 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User-Name: tempest-VolumesNegativeTest-1671649469-project-member Apr 14 15:41:57 user devstack@n-api.service[61875]: method: Apr 14 15:41:57 user devstack@n-api.service[61875]: exception: Volume tempest-invalid-1540503349 could not be found. Apr 14 15:41:57 user devstack@n-api.service[61875]: action_args: {'id': 'tempest-invalid-1540503349'} Apr 14 15:41:57 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1540503349 could not be found. (HTTP 404) (Request-ID: req-05a3053a-21df-4ace-948f-48fdfd533396) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1540503349 could not be found. Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1540503349 could not be found. Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1540503349 could not be found. Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-7b7e00ba-9457-43ad-b491-4b2a37ef2f43 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Returning 404 to user: Volume tempest-invalid-1540503349 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:41:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-7b7e00ba-9457-43ad-b491-4b2a37ef2f43 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1540503349" status: 404 len: 99 microversion: 2.1 time: 0.037615 Apr 14 15:41:57 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 110/334] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 15:41:57 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1540503349 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 14 15:41:57 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-893d0242-1001-4882-bf1e-2aab8ebf38d2 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005597 Apr 14 15:41:57 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 113/335] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 15:41:57 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 15:41:57 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-c69c5d12-2590-4304-9fb6-bf3d146231b2 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006418 Apr 14 15:41:57 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 113/336] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 14 15:41:57 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 15:41:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-309f29e5-7e91-4dd6-ae33-1562d3c765a1 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Calling method '.version_select at 0x7f29723ad510>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-309f29e5-7e91-4dd6-ae33-1562d3c765a1 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] HTTP exception thrown: Volume 56856474-17ed-4923-b5e4-d64f2890c998 could not be found. Apr 14 15:41:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-309f29e5-7e91-4dd6-ae33-1562d3c765a1 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Request method failure captured: Apr 14 15:41:57 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/os-volumes/56856474-17ed-4923-b5e4-d64f2890c998 HTTP/1.1 Apr 14 15:41:57 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:41:57 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:41:57 user devstack@n-api.service[61875]: Connection: close Apr 14 15:41:57 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:41:57 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:41:57 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:41:57 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:41:57 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXREcR4rugSZgkc4qq78oazBDQajk9tKbccL3OQuRCxxHu5wTYKco4Z0l81K4rn5iuKm4zHe8txndd-Z6aj_VdADk5E-0tiBJ18Rn9IAxtU0rIvBb6r3A31m4ZwiSuqYp26sIXiFQk5InNt5RRE_i-fISxN5st5JQJewJ0YXAU49jRQ Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Project-Id: b3ca8e495bcf48ba87a799c47a98a543 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Project-Name: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Tenant: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Tenant-Id: b3ca8e495bcf48ba87a799c47a98a543 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User: tempest-VolumesNegativeTest-1671649469-project-member Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User-Id: 5936cb42ca914307b098fc866376c516 Apr 14 15:41:57 user devstack@n-api.service[61875]: X-User-Name: tempest-VolumesNegativeTest-1671649469-project-member Apr 14 15:41:57 user devstack@n-api.service[61875]: method: Apr 14 15:41:57 user devstack@n-api.service[61875]: exception: Volume 56856474-17ed-4923-b5e4-d64f2890c998 could not be found. Apr 14 15:41:57 user devstack@n-api.service[61875]: action_args: {'id': '56856474-17ed-4923-b5e4-d64f2890c998'} Apr 14 15:41:57 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 56856474-17ed-4923-b5e4-d64f2890c998 could not be found. (HTTP 404) (Request-ID: req-582d3956-4648-4a1d-8303-f19d6e235b0c) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 56856474-17ed-4923-b5e4-d64f2890c998 could not be found. Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 56856474-17ed-4923-b5e4-d64f2890c998 could not be found. Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 56856474-17ed-4923-b5e4-d64f2890c998 could not be found. Apr 14 15:41:57 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-309f29e5-7e91-4dd6-ae33-1562d3c765a1 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Returning 404 to user: Volume 56856474-17ed-4923-b5e4-d64f2890c998 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:41:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-309f29e5-7e91-4dd6-ae33-1562d3c765a1 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/56856474-17ed-4923-b5e4-d64f2890c998" status: 404 len: 109 microversion: 2.1 time: 0.050419 Apr 14 15:41:57 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 111/337] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 15:41:57 2023] DELETE /compute/v2.1/os-volumes/56856474-17ed-4923-b5e4-d64f2890c998 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:41:57 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-654041c1-8af1-4229-8bea-7b0490c07194 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Calling method '.version_select at 0x7f2970aa2ef0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:41:57 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-654041c1-8af1-4229-8bea-7b0490c07194 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] HTTP exception thrown: Volume e4127521-0b88-4a98-8735-434f672c676e could not be found. Apr 14 15:41:57 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-654041c1-8af1-4229-8bea-7b0490c07194 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Request method failure captured: Apr 14 15:41:57 user devstack@n-api.service[61876]: request: GET /compute/v2.1/os-volumes/e4127521-0b88-4a98-8735-434f672c676e HTTP/1.1 Apr 14 15:41:57 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:41:57 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:41:57 user devstack@n-api.service[61876]: Connection: close Apr 14 15:41:57 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:41:57 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:41:57 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:41:57 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:41:57 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXREcR4rugSZgkc4qq78oazBDQajk9tKbccL3OQuRCxxHu5wTYKco4Z0l81K4rn5iuKm4zHe8txndd-Z6aj_VdADk5E-0tiBJ18Rn9IAxtU0rIvBb6r3A31m4ZwiSuqYp26sIXiFQk5InNt5RRE_i-fISxN5st5JQJewJ0YXAU49jRQ Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Project-Id: b3ca8e495bcf48ba87a799c47a98a543 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Project-Name: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3ca8e495bcf48ba87a799c47a98a543"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Tenant: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Tenant-Id: b3ca8e495bcf48ba87a799c47a98a543 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-VolumesNegativeTest-1671649469 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-User: tempest-VolumesNegativeTest-1671649469-project-member Apr 14 15:41:57 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:41:57 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:41:57 user devstack@n-api.service[61876]: X-User-Id: 5936cb42ca914307b098fc866376c516 Apr 14 15:41:57 user devstack@n-api.service[61876]: X-User-Name: tempest-VolumesNegativeTest-1671649469-project-member Apr 14 15:41:57 user devstack@n-api.service[61876]: method: Apr 14 15:41:57 user devstack@n-api.service[61876]: exception: Volume e4127521-0b88-4a98-8735-434f672c676e could not be found. Apr 14 15:41:57 user devstack@n-api.service[61876]: action_args: {'id': 'e4127521-0b88-4a98-8735-434f672c676e'} Apr 14 15:41:57 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4127521-0b88-4a98-8735-434f672c676e could not be found. (HTTP 404) (Request-ID: req-3f37a72c-d44a-4fde-a79e-567cc62f90d0) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4127521-0b88-4a98-8735-434f672c676e could not be found. Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4127521-0b88-4a98-8735-434f672c676e could not be found. Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4127521-0b88-4a98-8735-434f672c676e could not be found. Apr 14 15:41:57 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:41:57 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-654041c1-8af1-4229-8bea-7b0490c07194 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] Returning 404 to user: Volume e4127521-0b88-4a98-8735-434f672c676e could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:41:57 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-654041c1-8af1-4229-8bea-7b0490c07194 tempest-VolumesNegativeTest-1671649469 tempest-VolumesNegativeTest-1671649469-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e4127521-0b88-4a98-8735-434f672c676e" status: 404 len: 109 microversion: 2.1 time: 0.056435 Apr 14 15:41:57 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 114/338] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:41:57 2023] GET /compute/v2.1/os-volumes/e4127521-0b88-4a98-8735-434f672c676e => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:41:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-c71c87c6-00a8-47cf-9859-b00911d4bc4a tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "85863d5c-d474-423b-bc24-8bbbc104f9c5"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:41:58 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-c71c87c6-00a8-47cf-9859-b00911d4bc4a tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:41:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c71c87c6-00a8-47cf-9859-b00911d4bc4a tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c71c87c6-00a8-47cf-9859-b00911d4bc4a tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c71c87c6-00a8-47cf-9859-b00911d4bc4a tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c71c87c6-00a8-47cf-9859-b00911d4bc4a tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:41:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c71c87c6-00a8-47cf-9859-b00911d4bc4a tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:41:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c71c87c6-00a8-47cf-9859-b00911d4bc4a tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:41:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-c71c87c6-00a8-47cf-9859-b00911d4bc4a tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] HTTP exception thrown: Volume f44c0be5-4d0c-4038-9db2-dff8976867e4 could not be found. Apr 14 15:41:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-c71c87c6-00a8-47cf-9859-b00911d4bc4a tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Request method failure captured: Apr 14 15:41:58 user devstack@n-api.service[61874]: request: PUT /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32/os-volume_attachments/f44c0be5-4d0c-4038-9db2-dff8976867e4 HTTP/1.1 Apr 14 15:41:58 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:41:58 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:41:58 user devstack@n-api.service[61874]: Connection: close Apr 14 15:41:58 user devstack@n-api.service[61874]: Content-Length: 74 Apr 14 15:41:58 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:41:58 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:41:58 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:41:58 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXMbnNAxkAt5a7gPxJpswiHJBMQ5Bsisn7StpCOTbTFJsiLYmIjF_2dX-kwBhcBx91XNHIXd3QA0NkqVDPY3Iaxm9UmShoxahn9oOI6TEwpCiZyTqMmA0uTMrwu84V3Fx6o7BQUaTpME_e_smgrEXU5R89JopjHiNzOqot8kk_GY1is Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Project-Id: d1554476c59048d28071b22216e4ed51 Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Project-Name: tempest-VolumesAdminNegativeTest-1236380103 Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Role: admin,reader,member Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Roles: admin,reader,member Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1554476c59048d28071b22216e4ed51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1554476c59048d28071b22216e4ed51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1554476c59048d28071b22216e4ed51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Tenant: tempest-VolumesAdminNegativeTest-1236380103 Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Tenant-Id: d1554476c59048d28071b22216e4ed51 Apr 14 15:41:58 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1236380103 Apr 14 15:41:58 user devstack@n-api.service[61874]: X-User: tempest-VolumesAdminNegativeTest-1236380103-project-admin Apr 14 15:41:58 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:41:58 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:41:58 user devstack@n-api.service[61874]: X-User-Id: 74e84e7c3b3b42eb9f08208bb474b0ad Apr 14 15:41:58 user devstack@n-api.service[61874]: X-User-Name: tempest-VolumesAdminNegativeTest-1236380103-project-admin Apr 14 15:41:58 user devstack@n-api.service[61874]: Apr 14 15:41:58 user devstack@n-api.service[61874]: {"volumeAttachment": {"volumeId": "85863d5c-d474-423b-bc24-8bbbc104f9c5"}} Apr 14 15:41:58 user devstack@n-api.service[61874]: method: > Apr 14 15:41:58 user devstack@n-api.service[61874]: exception: Volume f44c0be5-4d0c-4038-9db2-dff8976867e4 could not be found. Apr 14 15:41:58 user devstack@n-api.service[61874]: action_args: {'server_id': '19de875a-a784-46f6-8c6e-f2fad198ba32', 'id': 'f44c0be5-4d0c-4038-9db2-dff8976867e4', 'body': {'volumeAttachment': {'volumeId': '85863d5c-d474-423b-bc24-8bbbc104f9c5'}}} Apr 14 15:41:58 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f44c0be5-4d0c-4038-9db2-dff8976867e4 could not be found. (HTTP 404) (Request-ID: req-a2e9ad2e-4cf4-45e3-8531-bda65741103e) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f44c0be5-4d0c-4038-9db2-dff8976867e4 could not be found. Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f44c0be5-4d0c-4038-9db2-dff8976867e4 could not be found. Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f44c0be5-4d0c-4038-9db2-dff8976867e4 could not be found. Apr 14 15:41:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:41:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-c71c87c6-00a8-47cf-9859-b00911d4bc4a tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] Returning 404 to user: Volume f44c0be5-4d0c-4038-9db2-dff8976867e4 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:41:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-c71c87c6-00a8-47cf-9859-b00911d4bc4a tempest-VolumesAdminNegativeTest-1236380103 tempest-VolumesAdminNegativeTest-1236380103-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32/os-volume_attachments/f44c0be5-4d0c-4038-9db2-dff8976867e4" status: 404 len: 109 microversion: 2.1 time: 0.106555 Apr 14 15:41:58 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 114/339] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 15:41:58 2023] PUT /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32/os-volume_attachments/f44c0be5-4d0c-4038-9db2-dff8976867e4 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:42:02 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:42:02 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:02 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:42:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32" status: 204 len: 0 microversion: 2.1 time: 0.141561 Apr 14 15:42:02 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 112/340] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:42:02 2023] DELETE /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:42:02 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-2e730f83-dda1-4c4e-b179-fcd82e5ff1f4 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:42:02 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-2e730f83-dda1-4c4e-b179-fcd82e5ff1f4 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2e730f83-dda1-4c4e-b179-fcd82e5ff1f4 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2e730f83-dda1-4c4e-b179-fcd82e5ff1f4 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2e730f83-dda1-4c4e-b179-fcd82e5ff1f4 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2e730f83-dda1-4c4e-b179-fcd82e5ff1f4 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2e730f83-dda1-4c4e-b179-fcd82e5ff1f4 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2e730f83-dda1-4c4e-b179-fcd82e5ff1f4 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:02 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-2e730f83-dda1-4c4e-b179-fcd82e5ff1f4 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1aa921f86bd4f3b88eb782d5f667816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '029b8c395f264a86933a9e878c18e0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:42:03 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-2e730f83-dda1-4c4e-b179-fcd82e5ff1f4 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32" status: 200 len: 1502 microversion: 2.1 time: 0.695911 Apr 14 15:42:03 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 115/341] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:42:02 2023] GET /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32 => generated 1502 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:42:03 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-62a805fa-908a-4588-bf02-f112631687da req-e519c2d4-f739-46ad-9035-6e0330a47b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19de875a-a784-46f6-8c6e-f2fad198ba32", "name": "network-vif-unplugged", "status": "completed", "tag": "12f4faa8-1f30-4403-9114-14195ee6d862"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-62a805fa-908a-4588-bf02-f112631687da req-e519c2d4-f739-46ad-9035-6e0330a47b32 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-62a805fa-908a-4588-bf02-f112631687da req-e519c2d4-f739-46ad-9035-6e0330a47b32 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-62a805fa-908a-4588-bf02-f112631687da req-e519c2d4-f739-46ad-9035-6e0330a47b32 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:03 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-62a805fa-908a-4588-bf02-f112631687da req-e519c2d4-f739-46ad-9035-6e0330a47b32 service nova] Creating event network-vif-unplugged:12f4faa8-1f30-4403-9114-14195ee6d862 for instance 19de875a-a784-46f6-8c6e-f2fad198ba32 on user Apr 14 15:42:03 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-62a805fa-908a-4588-bf02-f112631687da req-e519c2d4-f739-46ad-9035-6e0330a47b32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.278424 Apr 14 15:42:03 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:42:04 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-517c3a8a-ccca-466a-b16a-a67a1706b0bc req-a9ab9d36-aeb5-4ad0-b4bc-d0525e592b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19de875a-a784-46f6-8c6e-f2fad198ba32", "name": "network-vif-deleted", "tag": "12f4faa8-1f30-4403-9114-14195ee6d862"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-517c3a8a-ccca-466a-b16a-a67a1706b0bc req-a9ab9d36-aeb5-4ad0-b4bc-d0525e592b2c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-517c3a8a-ccca-466a-b16a-a67a1706b0bc req-a9ab9d36-aeb5-4ad0-b4bc-d0525e592b2c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-517c3a8a-ccca-466a-b16a-a67a1706b0bc req-a9ab9d36-aeb5-4ad0-b4bc-d0525e592b2c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-517c3a8a-ccca-466a-b16a-a67a1706b0bc req-a9ab9d36-aeb5-4ad0-b4bc-d0525e592b2c service nova] Creating event network-vif-deleted:12f4faa8-1f30-4403-9114-14195ee6d862 for instance 19de875a-a784-46f6-8c6e-f2fad198ba32 on user Apr 14 15:42:05 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-517c3a8a-ccca-466a-b16a-a67a1706b0bc req-a9ab9d36-aeb5-4ad0-b4bc-d0525e592b2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134580 Apr 14 15:42:05 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 113/343] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:42:05 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-686f81c0-8890-4f7b-94ba-d88ad534ca89 req-ceba6cab-3672-4cae-ac4c-000028cab622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19de875a-a784-46f6-8c6e-f2fad198ba32", "name": "network-vif-plugged", "status": "completed", "tag": "12f4faa8-1f30-4403-9114-14195ee6d862"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-686f81c0-8890-4f7b-94ba-d88ad534ca89 req-ceba6cab-3672-4cae-ac4c-000028cab622 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-686f81c0-8890-4f7b-94ba-d88ad534ca89 req-ceba6cab-3672-4cae-ac4c-000028cab622 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-686f81c0-8890-4f7b-94ba-d88ad534ca89 req-ceba6cab-3672-4cae-ac4c-000028cab622 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:05 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-686f81c0-8890-4f7b-94ba-d88ad534ca89 req-ceba6cab-3672-4cae-ac4c-000028cab622 service nova] Creating event network-vif-plugged:12f4faa8-1f30-4403-9114-14195ee6d862 for instance 19de875a-a784-46f6-8c6e-f2fad198ba32 on user Apr 14 15:42:05 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-686f81c0-8890-4f7b-94ba-d88ad534ca89 req-ceba6cab-3672-4cae-ac4c-000028cab622 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045609 Apr 14 15:42:05 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 116/344] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:42:09 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-eb8aeccc-e81c-4ffe-8d63-8804a584a785 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-138480177", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "16eaa650-a090-4974-bb68-301421b2c7fc", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40"}]}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-eb8aeccc-e81c-4ffe-8d63-8804a584a785 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] HTTP exception thrown: Block Device 16eaa650-a090-4974-bb68-301421b2c7fc is not bootable. Apr 14 15:42:09 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-eb8aeccc-e81c-4ffe-8d63-8804a584a785 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Request method failure captured: Apr 14 15:42:09 user devstack@n-api.service[61874]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 15:42:09 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:42:09 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:42:09 user devstack@n-api.service[61874]: Connection: close Apr 14 15:42:09 user devstack@n-api.service[61874]: Content-Length: 356 Apr 14 15:42:09 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:42:09 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:42:09 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:42:09 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXL95JWLmONfTrhpJmmUWoidh6SxM6nOj4T6nb8eiCzGyQ8xri5QYFuYNhdtZLUHL4oGnJqSuEepZDj66OEbgJzZJeiNKYrkGdM78HBIq2CBd_mG7YSrfK2eef4zoe0o--DIA0Ny5tXerL6dbd4mO3kxcJGCA4XuQGooGSa-qHGlW8A Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Project-Id: 3a8e73ef2ad94e84876def53ddf43da4 Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Project-Name: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Tenant: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Tenant-Id: 3a8e73ef2ad94e84876def53ddf43da4 Apr 14 15:42:09 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:42:09 user devstack@n-api.service[61874]: X-User: tempest-ServersNegativeTestJSON-443911091-project-member Apr 14 15:42:09 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:42:09 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:42:09 user devstack@n-api.service[61874]: X-User-Id: af824b840c604223afd90bce17fe1ceb Apr 14 15:42:09 user devstack@n-api.service[61874]: X-User-Name: tempest-ServersNegativeTestJSON-443911091-project-member Apr 14 15:42:09 user devstack@n-api.service[61874]: Apr 14 15:42:09 user devstack@n-api.service[61874]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-138480177", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "16eaa650-a090-4974-bb68-301421b2c7fc", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40"}]}} Apr 14 15:42:09 user devstack@n-api.service[61874]: method: > Apr 14 15:42:09 user devstack@n-api.service[61874]: exception: Block Device 16eaa650-a090-4974-bb68-301421b2c7fc is not bootable. Apr 14 15:42:09 user devstack@n-api.service[61874]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-138480177', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '16eaa650-a090-4974-bb68-301421b2c7fc'}], 'networks': [{'uuid': 'dd14d44b-4a04-4aa4-9dfd-1933f29c3a40'}]}}} Apr 14 15:42:09 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 16eaa650-a090-4974-bb68-301421b2c7fc is not bootable. Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 16eaa650-a090-4974-bb68-301421b2c7fc is not bootable. Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 16eaa650-a090-4974-bb68-301421b2c7fc is not bootable. Apr 14 15:42:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:42:09 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-eb8aeccc-e81c-4ffe-8d63-8804a584a785 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Returning 400 to user: Block Device 16eaa650-a090-4974-bb68-301421b2c7fc is not bootable. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:42:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-eb8aeccc-e81c-4ffe-8d63-8804a584a785 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.073857 Apr 14 15:42:09 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 116/345] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:42:09 2023] POST /compute/v2.1/servers => generated 110 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:42:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-18b19bdf-f759-4d93-8c0e-cd7e362c141a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:42:09 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-18b19bdf-f759-4d93-8c0e-cd7e362c141a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-18b19bdf-f759-4d93-8c0e-cd7e362c141a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-18b19bdf-f759-4d93-8c0e-cd7e362c141a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-18b19bdf-f759-4d93-8c0e-cd7e362c141a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-18b19bdf-f759-4d93-8c0e-cd7e362c141a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-18b19bdf-f759-4d93-8c0e-cd7e362c141a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-18b19bdf-f759-4d93-8c0e-cd7e362c141a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:09 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-18b19bdf-f759-4d93-8c0e-cd7e362c141a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af824b840c604223afd90bce17fe1ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e73ef2ad94e84876def53ddf43da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:42:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-18b19bdf-f759-4d93-8c0e-cd7e362c141a tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a" status: 200 len: 1494 microversion: 2.1 time: 0.314673 Apr 14 15:42:09 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 114/346] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:42:09 2023] GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a => generated 1494 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:42:17 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:42:17 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:42:17 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "8aae4aad-6003-4434-bde0-93ff7ad3d2b1"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:17 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:17 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'flavor' on Instance uuid e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:42:17 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/action" status: 200 len: 29 microversion: 2.87 time: 0.547649 Apr 14 15:42:17 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 117/347] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 15:42:17 2023] POST /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/action => generated 29 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:42:17 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:42:17 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-ba6943c8-9262-4660-9ead-90fb7785ee1f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:42:17 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-ba6943c8-9262-4660-9ead-90fb7785ee1f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ba6943c8-9262-4660-9ead-90fb7785ee1f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ba6943c8-9262-4660-9ead-90fb7785ee1f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ba6943c8-9262-4660-9ead-90fb7785ee1f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ba6943c8-9262-4660-9ead-90fb7785ee1f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ba6943c8-9262-4660-9ead-90fb7785ee1f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ba6943c8-9262-4660-9ead-90fb7785ee1f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:17 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-ba6943c8-9262-4660-9ead-90fb7785ee1f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:42:17 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-ba6943c8-9262-4660-9ead-90fb7785ee1f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:42:17 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-ba6943c8-9262-4660-9ead-90fb7785ee1f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:42:17 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-ba6943c8-9262-4660-9ead-90fb7785ee1f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" status: 200 len: 1774 microversion: 2.87 time: 0.362443 Apr 14 15:42:17 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 117/348] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:42:17 2023] GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => generated 1774 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:42:18 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-5f44c28d-8212-4ff1-8988-6c8f3acbfecc req-977e309b-df8c-4503-a171-4bc4238c0fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-unplugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5f44c28d-8212-4ff1-8988-6c8f3acbfecc req-977e309b-df8c-4503-a171-4bc4238c0fb7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5f44c28d-8212-4ff1-8988-6c8f3acbfecc req-977e309b-df8c-4503-a171-4bc4238c0fb7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5f44c28d-8212-4ff1-8988-6c8f3acbfecc req-977e309b-df8c-4503-a171-4bc4238c0fb7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:18 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-5f44c28d-8212-4ff1-8988-6c8f3acbfecc req-977e309b-df8c-4503-a171-4bc4238c0fb7 service nova] Creating event network-vif-unplugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:42:18 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-5f44c28d-8212-4ff1-8988-6c8f3acbfecc req-977e309b-df8c-4503-a171-4bc4238c0fb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.241159 Apr 14 15:42:18 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 115/349] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:42:20 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-34639d4a-5bf6-4cfb-b50a-001dc491214d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:42:20 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-34639d4a-5bf6-4cfb-b50a-001dc491214d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-34639d4a-5bf6-4cfb-b50a-001dc491214d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-34639d4a-5bf6-4cfb-b50a-001dc491214d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-34639d4a-5bf6-4cfb-b50a-001dc491214d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-34639d4a-5bf6-4cfb-b50a-001dc491214d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-34639d4a-5bf6-4cfb-b50a-001dc491214d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-34639d4a-5bf6-4cfb-b50a-001dc491214d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:20 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-34639d4a-5bf6-4cfb-b50a-001dc491214d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:42:20 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-34639d4a-5bf6-4cfb-b50a-001dc491214d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36" status: 200 len: 1537 microversion: 2.1 time: 0.393160 Apr 14 15:42:20 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 118/350] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:42:20 2023] GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36 => generated 1537 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:42:20 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-17d9a625-9054-4d28-b080-07491f70c540 req-973d96db-1d3c-421a-a570-0d2995779c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-plugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-17d9a625-9054-4d28-b080-07491f70c540 req-973d96db-1d3c-421a-a570-0d2995779c53 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-17d9a625-9054-4d28-b080-07491f70c540 req-973d96db-1d3c-421a-a570-0d2995779c53 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-17d9a625-9054-4d28-b080-07491f70c540 req-973d96db-1d3c-421a-a570-0d2995779c53 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-17d9a625-9054-4d28-b080-07491f70c540 req-973d96db-1d3c-421a-a570-0d2995779c53 service nova] Creating event network-vif-plugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:42:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-17d9a625-9054-4d28-b080-07491f70c540 req-973d96db-1d3c-421a-a570-0d2995779c53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045111 Apr 14 15:42:20 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 118/351] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:42:22 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a205ada7-7171-4aae-9493-a963a91995b4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:42:22 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a205ada7-7171-4aae-9493-a963a91995b4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a205ada7-7171-4aae-9493-a963a91995b4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a205ada7-7171-4aae-9493-a963a91995b4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a205ada7-7171-4aae-9493-a963a91995b4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a205ada7-7171-4aae-9493-a963a91995b4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a205ada7-7171-4aae-9493-a963a91995b4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a205ada7-7171-4aae-9493-a963a91995b4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:22 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-a205ada7-7171-4aae-9493-a963a91995b4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:42:22 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a205ada7-7171-4aae-9493-a963a91995b4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4" status: 200 len: 1488 microversion: 2.1 time: 0.334496 Apr 14 15:42:22 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 116/352] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:42:22 2023] GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4 => generated 1488 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:42:23 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-a85e082f-5ec4-4aef-96b1-3ab8724aca8f req-6d818a50-7b08-41a3-8c61-9d56caf79c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-plugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a85e082f-5ec4-4aef-96b1-3ab8724aca8f req-6d818a50-7b08-41a3-8c61-9d56caf79c90 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a85e082f-5ec4-4aef-96b1-3ab8724aca8f req-6d818a50-7b08-41a3-8c61-9d56caf79c90 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a85e082f-5ec4-4aef-96b1-3ab8724aca8f req-6d818a50-7b08-41a3-8c61-9d56caf79c90 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-a85e082f-5ec4-4aef-96b1-3ab8724aca8f req-6d818a50-7b08-41a3-8c61-9d56caf79c90 service nova] Creating event network-vif-plugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:42:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-a85e082f-5ec4-4aef-96b1-3ab8724aca8f req-6d818a50-7b08-41a3-8c61-9d56caf79c90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072270 Apr 14 15:42:23 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 119/353] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:42:25 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-ad4f7ba3-3602-4bdd-ac5b-77825e7849a3 req-f2240585-8bc0-43f2-a1cb-2794b62b426a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-plugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ad4f7ba3-3602-4bdd-ac5b-77825e7849a3 req-f2240585-8bc0-43f2-a1cb-2794b62b426a service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ad4f7ba3-3602-4bdd-ac5b-77825e7849a3 req-f2240585-8bc0-43f2-a1cb-2794b62b426a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ad4f7ba3-3602-4bdd-ac5b-77825e7849a3 req-f2240585-8bc0-43f2-a1cb-2794b62b426a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-ad4f7ba3-3602-4bdd-ac5b-77825e7849a3 req-f2240585-8bc0-43f2-a1cb-2794b62b426a service nova] Creating event network-vif-plugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:42:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-ad4f7ba3-3602-4bdd-ac5b-77825e7849a3 req-f2240585-8bc0-43f2-a1cb-2794b62b426a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047340 Apr 14 15:42:25 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 119/354] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:42:34 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:34 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:34 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:42:34 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:42:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:34 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/action" status: 202 len: 0 microversion: 2.1 time: 0.171834 Apr 14 15:42:34 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 117/355] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:42:34 2023] POST /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:42:35 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:42:35 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:42:35 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-a2928d19-5e2f-44d9-a22c-54328e097adb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:42:35 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-a2928d19-5e2f-44d9-a22c-54328e097adb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a2928d19-5e2f-44d9-a22c-54328e097adb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a2928d19-5e2f-44d9-a22c-54328e097adb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a2928d19-5e2f-44d9-a22c-54328e097adb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a2928d19-5e2f-44d9-a22c-54328e097adb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a2928d19-5e2f-44d9-a22c-54328e097adb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a2928d19-5e2f-44d9-a22c-54328e097adb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:35 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-a2928d19-5e2f-44d9-a22c-54328e097adb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.319963 Apr 14 15:42:35 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 120/356] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 15:42:35 2023] GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/os-interface => generated 282 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:42:36 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=14 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:42:36 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=10 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:42:36 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-52dca0b2-66f6-4633-86d9-8cf7cafeb94f req-b87f12fe-dac9-4c33-88a9-1392cc78608f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-unplugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-52dca0b2-66f6-4633-86d9-8cf7cafeb94f req-b87f12fe-dac9-4c33-88a9-1392cc78608f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-52dca0b2-66f6-4633-86d9-8cf7cafeb94f req-b87f12fe-dac9-4c33-88a9-1392cc78608f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-52dca0b2-66f6-4633-86d9-8cf7cafeb94f req-b87f12fe-dac9-4c33-88a9-1392cc78608f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:36 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-52dca0b2-66f6-4633-86d9-8cf7cafeb94f req-b87f12fe-dac9-4c33-88a9-1392cc78608f service nova] Creating event network-vif-unplugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:42:36 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-52dca0b2-66f6-4633-86d9-8cf7cafeb94f req-b87f12fe-dac9-4c33-88a9-1392cc78608f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060028 Apr 14 15:42:36 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 120/357] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:42:36 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] Creating event network-changed:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:42:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047030 Apr 14 15:42:36 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 118/358] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:42:38 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-144b0e53-2d7a-4c8d-9ef8-88e2943cc443 req-419a2ef8-c915-4acc-97f4-e47b5b6637d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-plugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-144b0e53-2d7a-4c8d-9ef8-88e2943cc443 req-419a2ef8-c915-4acc-97f4-e47b5b6637d4 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-144b0e53-2d7a-4c8d-9ef8-88e2943cc443 req-419a2ef8-c915-4acc-97f4-e47b5b6637d4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-144b0e53-2d7a-4c8d-9ef8-88e2943cc443 req-419a2ef8-c915-4acc-97f4-e47b5b6637d4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:38 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-144b0e53-2d7a-4c8d-9ef8-88e2943cc443 req-419a2ef8-c915-4acc-97f4-e47b5b6637d4 service nova] Creating event network-vif-plugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:42:38 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-144b0e53-2d7a-4c8d-9ef8-88e2943cc443 req-419a2ef8-c915-4acc-97f4-e47b5b6637d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042402 Apr 14 15:42:38 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 121/359] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:42:38 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:38 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] Creating event network-changed:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:42:38 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036915 Apr 14 15:42:38 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 121/360] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:42:40 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-plugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}, {"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-plugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] Creating event network-vif-plugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:42:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] Creating event network-vif-plugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:42:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032731 Apr 14 15:42:40 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 119/361] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:42:44 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-2d66395e-7698-4173-b62e-288ab797325b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:42:44 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-2d66395e-7698-4173-b62e-288ab797325b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2d66395e-7698-4173-b62e-288ab797325b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2d66395e-7698-4173-b62e-288ab797325b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2d66395e-7698-4173-b62e-288ab797325b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2d66395e-7698-4173-b62e-288ab797325b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2d66395e-7698-4173-b62e-288ab797325b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2d66395e-7698-4173-b62e-288ab797325b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:44 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-2d66395e-7698-4173-b62e-288ab797325b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.199305 Apr 14 15:42:44 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 122/362] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 15:42:44 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-interface => generated 283 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:42:45 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:45 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] Creating event network-changed:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:42:45 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043029 Apr 14 15:42:45 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 122/363] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:42:46 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b5961549-5120-4c2a-a470-79c9496a6b20 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:42:46 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-b5961549-5120-4c2a-a470-79c9496a6b20 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b5961549-5120-4c2a-a470-79c9496a6b20 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b5961549-5120-4c2a-a470-79c9496a6b20 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b5961549-5120-4c2a-a470-79c9496a6b20 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b5961549-5120-4c2a-a470-79c9496a6b20 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b5961549-5120-4c2a-a470-79c9496a6b20 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b5961549-5120-4c2a-a470-79c9496a6b20 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:46 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-b5961549-5120-4c2a-a470-79c9496a6b20 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:42:46 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-b5961549-5120-4c2a-a470-79c9496a6b20 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1539 microversion: 2.1 time: 0.191419 Apr 14 15:42:46 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 120/364] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:42:45 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1539 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:42:46 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-c01235df-daa9-4d99-9b44-7cd6fefd3bc0 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:42:46 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-c01235df-daa9-4d99-9b44-7cd6fefd3bc0 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c01235df-daa9-4d99-9b44-7cd6fefd3bc0 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c01235df-daa9-4d99-9b44-7cd6fefd3bc0 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c01235df-daa9-4d99-9b44-7cd6fefd3bc0 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c01235df-daa9-4d99-9b44-7cd6fefd3bc0 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c01235df-daa9-4d99-9b44-7cd6fefd3bc0 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c01235df-daa9-4d99-9b44-7cd6fefd3bc0 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:46 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-c01235df-daa9-4d99-9b44-7cd6fefd3bc0 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:42:46 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-c01235df-daa9-4d99-9b44-7cd6fefd3bc0 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1539 microversion: 2.1 time: 0.264467 Apr 14 15:42:46 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 123/365] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:42:46 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1539 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:42:53 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2539497b-8a4c-4f27-b28e-98384fd42d66 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:42:53 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-2539497b-8a4c-4f27-b28e-98384fd42d66 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2539497b-8a4c-4f27-b28e-98384fd42d66 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2539497b-8a4c-4f27-b28e-98384fd42d66 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2539497b-8a4c-4f27-b28e-98384fd42d66 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2539497b-8a4c-4f27-b28e-98384fd42d66 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2539497b-8a4c-4f27-b28e-98384fd42d66 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2539497b-8a4c-4f27-b28e-98384fd42d66 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:53 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-2539497b-8a4c-4f27-b28e-98384fd42d66 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] HTTP exception thrown: Instance 19de875a-a784-46f6-8c6e-f2fad198ba32 could not be found. Apr 14 15:42:53 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2539497b-8a4c-4f27-b28e-98384fd42d66 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Request method failure captured: Apr 14 15:42:53 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32 HTTP/1.1 Apr 14 15:42:53 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:42:53 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:42:53 user devstack@n-api.service[61874]: Connection: close Apr 14 15:42:53 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:42:53 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:42:53 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:42:53 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:42:53 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXMNsRCbjFp3Cj5vRe0W-2HiqIYQxHk-9MpVmGCYCs2lJgB5jNIN2zlXPDz31NFQLUpJnVKwCv0dipeHdaK4qVzme-N0--J_PkaC-x6esCB5qtv21zUjwz-XvHiQcI4cMKdHe9GqgMQjEYTBMZruLRYRe4ow2rkrVw4Zv0sfJFb6f3c Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Project-Id: 029b8c395f264a86933a9e878c18e0b2 Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Project-Name: tempest-VolumesAdminNegativeTest-1127532 Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/029b8c395f264a86933a9e878c18e0b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/029b8c395f264a86933a9e878c18e0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/029b8c395f264a86933a9e878c18e0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Tenant: tempest-VolumesAdminNegativeTest-1127532 Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Tenant-Id: 029b8c395f264a86933a9e878c18e0b2 Apr 14 15:42:53 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1127532 Apr 14 15:42:53 user devstack@n-api.service[61874]: X-User: tempest-VolumesAdminNegativeTest-1127532-project-member Apr 14 15:42:53 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:42:53 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:42:53 user devstack@n-api.service[61874]: X-User-Id: e1aa921f86bd4f3b88eb782d5f667816 Apr 14 15:42:53 user devstack@n-api.service[61874]: X-User-Name: tempest-VolumesAdminNegativeTest-1127532-project-member Apr 14 15:42:53 user devstack@n-api.service[61874]: method: > Apr 14 15:42:53 user devstack@n-api.service[61874]: exception: Instance 19de875a-a784-46f6-8c6e-f2fad198ba32 could not be found. Apr 14 15:42:53 user devstack@n-api.service[61874]: action_args: {'id': '19de875a-a784-46f6-8c6e-f2fad198ba32'} Apr 14 15:42:53 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19de875a-a784-46f6-8c6e-f2fad198ba32 could not be found. Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19de875a-a784-46f6-8c6e-f2fad198ba32 could not be found. Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19de875a-a784-46f6-8c6e-f2fad198ba32 could not be found. Apr 14 15:42:53 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:42:53 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2539497b-8a4c-4f27-b28e-98384fd42d66 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Returning 404 to user: Instance 19de875a-a784-46f6-8c6e-f2fad198ba32 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:42:53 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-2539497b-8a4c-4f27-b28e-98384fd42d66 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32" status: 404 len: 111 microversion: 2.1 time: 0.034909 Apr 14 15:42:53 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 123/366] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:42:53 2023] GET /compute/v2.1/servers/19de875a-a784-46f6-8c6e-f2fad198ba32 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:42:56 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:42:56 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:56 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=8 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:42:56 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:42:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:56 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:42:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0" status: 204 len: 0 microversion: 2.1 time: 0.221165 Apr 14 15:42:56 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 121/367] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:42:56 2023] DELETE /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:42:56 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ee24fbfd-f7b4-433b-a75c-e6281b8030b6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:42:56 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ee24fbfd-f7b4-433b-a75c-e6281b8030b6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:42:56 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:42:56 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=16 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:42:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ee24fbfd-f7b4-433b-a75c-e6281b8030b6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ee24fbfd-f7b4-433b-a75c-e6281b8030b6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ee24fbfd-f7b4-433b-a75c-e6281b8030b6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ee24fbfd-f7b4-433b-a75c-e6281b8030b6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ee24fbfd-f7b4-433b-a75c-e6281b8030b6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ee24fbfd-f7b4-433b-a75c-e6281b8030b6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:57 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-ee24fbfd-f7b4-433b-a75c-e6281b8030b6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1aa921f86bd4f3b88eb782d5f667816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '029b8c395f264a86933a9e878c18e0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:42:57 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ee24fbfd-f7b4-433b-a75c-e6281b8030b6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0" status: 200 len: 1669 microversion: 2.1 time: 0.503110 Apr 14 15:42:57 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 124/368] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:42:56 2023] GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0 => generated 1669 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:42:57 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-5d6f91a6-8051-4898-9d24-d10695b5a5bf req-9810762c-c8b7-4d8a-9a98-50772da2cd02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f094302b-0730-4754-b9e9-ec203312b8c0", "name": "network-vif-unplugged", "status": "completed", "tag": "674fa5df-38fc-4d44-9f38-fbae08c80e81"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-5d6f91a6-8051-4898-9d24-d10695b5a5bf req-9810762c-c8b7-4d8a-9a98-50772da2cd02 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-5d6f91a6-8051-4898-9d24-d10695b5a5bf req-9810762c-c8b7-4d8a-9a98-50772da2cd02 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-5d6f91a6-8051-4898-9d24-d10695b5a5bf req-9810762c-c8b7-4d8a-9a98-50772da2cd02 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:57 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-5d6f91a6-8051-4898-9d24-d10695b5a5bf req-9810762c-c8b7-4d8a-9a98-50772da2cd02 service nova] Creating event network-vif-unplugged:674fa5df-38fc-4d44-9f38-fbae08c80e81 for instance f094302b-0730-4754-b9e9-ec203312b8c0 on user Apr 14 15:42:57 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-5d6f91a6-8051-4898-9d24-d10695b5a5bf req-9810762c-c8b7-4d8a-9a98-50772da2cd02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042352 Apr 14 15:42:57 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 124/369] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:42:59 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-048cd7e3-9d8c-46f7-a1e3-82068f14a144 req-94ae9f04-acef-41e4-bdc6-f793679663b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f094302b-0730-4754-b9e9-ec203312b8c0", "name": "network-vif-plugged", "status": "completed", "tag": "674fa5df-38fc-4d44-9f38-fbae08c80e81"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:42:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-048cd7e3-9d8c-46f7-a1e3-82068f14a144 req-94ae9f04-acef-41e4-bdc6-f793679663b9 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:42:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-048cd7e3-9d8c-46f7-a1e3-82068f14a144 req-94ae9f04-acef-41e4-bdc6-f793679663b9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:42:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-048cd7e3-9d8c-46f7-a1e3-82068f14a144 req-94ae9f04-acef-41e4-bdc6-f793679663b9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:42:59 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-048cd7e3-9d8c-46f7-a1e3-82068f14a144 req-94ae9f04-acef-41e4-bdc6-f793679663b9 service nova] Creating event network-vif-plugged:674fa5df-38fc-4d44-9f38-fbae08c80e81 for instance f094302b-0730-4754-b9e9-ec203312b8c0 on user Apr 14 15:42:59 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-048cd7e3-9d8c-46f7-a1e3-82068f14a144 req-94ae9f04-acef-41e4-bdc6-f793679663b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030737 Apr 14 15:42:59 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 122/370] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:42:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:01 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-7ff87237-ab1f-42ce-910c-9230dc737262 req-b6e13c72-9524-44ed-89be-1ac9d97c9ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f094302b-0730-4754-b9e9-ec203312b8c0", "name": "network-vif-deleted", "tag": "674fa5df-38fc-4d44-9f38-fbae08c80e81"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-7ff87237-ab1f-42ce-910c-9230dc737262 req-b6e13c72-9524-44ed-89be-1ac9d97c9ecd service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-7ff87237-ab1f-42ce-910c-9230dc737262 req-b6e13c72-9524-44ed-89be-1ac9d97c9ecd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-7ff87237-ab1f-42ce-910c-9230dc737262 req-b6e13c72-9524-44ed-89be-1ac9d97c9ecd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-7ff87237-ab1f-42ce-910c-9230dc737262 req-b6e13c72-9524-44ed-89be-1ac9d97c9ecd service nova] Creating event network-vif-deleted:674fa5df-38fc-4d44-9f38-fbae08c80e81 for instance f094302b-0730-4754-b9e9-ec203312b8c0 on user Apr 14 15:43:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-7ff87237-ab1f-42ce-910c-9230dc737262 req-b6e13c72-9524-44ed-89be-1ac9d97c9ecd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089006 Apr 14 15:43:01 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 125/371] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:04 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-320538f2-1c89-4406-b7af-8bf4fd141404 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Action: 'create', calling method: .version_select at 0x7f2970bd9e10>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-2098361315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFha8odW+z7ISDIuPdSZePdAynxjWLOIGWY2I6lL7a2QwhfFIdZm7ObXMS8bvQTWc0DBFIrcJxz8DhdLKuke9J8N3t2DQvcIs9S9uYys2p7+hpLefYLxHN59XZ9twQcsw=="}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:04 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-320538f2-1c89-4406-b7af-8bf4fd141404 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Getting quotas for project 737ea257ab5448389bd751841be0fc72. Resources: {'key_pairs'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:43:04 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-320538f2-1c89-4406-b7af-8bf4fd141404 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Getting quotas for user 4ee063f686de4a9f9e6b5fe1e7ce2c3a and project 737ea257ab5448389bd751841be0fc72. Resources: {'key_pairs'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:43:04 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-320538f2-1c89-4406-b7af-8bf4fd141404 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.309239 Apr 14 15:43:04 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 125/372] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 15:43:04 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:06 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1933872661", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-2098361315", "security_groups": [{"name": "tempest-secgroup-smoke-1805051126"}], "networks": [{"uuid": "aba8209a-8778-4768-a248-62e4ec4c0dba"}]}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:06 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] validate_networks() for [('aba8209a-8778-4768-a248-62e4ec4c0dba', None, None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Getting quotas for project 737ea257ab5448389bd751841be0fc72. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Getting quotas for user 4ee063f686de4a9f9e6b5fe1e7ce2c3a and project 737ea257ab5448389bd751841be0fc72. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:43:07 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:43:07 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.871759 Apr 14 15:43:07 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 123/373] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:43:06 2023] POST /compute/v2.1/servers => generated 404 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:43:07 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-73bb3371-abd9-4c6d-b280-1ce71aebc489 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:07 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-73bb3371-abd9-4c6d-b280-1ce71aebc489 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:07 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-73bb3371-abd9-4c6d-b280-1ce71aebc489 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee063f686de4a9f9e6b5fe1e7ce2c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737ea257ab5448389bd751841be0fc72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:07 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-73bb3371-abd9-4c6d-b280-1ce71aebc489 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48" status: 200 len: 1257 microversion: 2.1 time: 0.103940 Apr 14 15:43:07 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 126/374] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:43:07 2023] GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48 => generated 1257 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 15:43:08 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-b657dddb-d25a-4d25-a83e-f5b35ee01d43 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:08 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-b657dddb-d25a-4d25-a83e-f5b35ee01d43 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:08 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=10 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:08 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b657dddb-d25a-4d25-a83e-f5b35ee01d43 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b657dddb-d25a-4d25-a83e-f5b35ee01d43 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b657dddb-d25a-4d25-a83e-f5b35ee01d43 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b657dddb-d25a-4d25-a83e-f5b35ee01d43 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b657dddb-d25a-4d25-a83e-f5b35ee01d43 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b657dddb-d25a-4d25-a83e-f5b35ee01d43 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:08 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:08 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:08 user devstack@n-api.service[61875]: DEBUG nova.objects.instance [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'services' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=61875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:43:08 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/os-volume_attachments/2f60c4f2-a281-469b-9c0e-cf96631f965c" status: 202 len: 0 microversion: 2.1 time: 0.189125 Apr 14 15:43:08 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 124/375] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:43:08 2023] DELETE /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/os-volume_attachments/2f60c4f2-a281-469b-9c0e-cf96631f965c => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:43:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ffacb693-f01c-4195-bf3a-bf76f465670f tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:08 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ffacb693-f01c-4195-bf3a-bf76f465670f tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ffacb693-f01c-4195-bf3a-bf76f465670f tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ffacb693-f01c-4195-bf3a-bf76f465670f tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ffacb693-f01c-4195-bf3a-bf76f465670f tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ffacb693-f01c-4195-bf3a-bf76f465670f tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ffacb693-f01c-4195-bf3a-bf76f465670f tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ffacb693-f01c-4195-bf3a-bf76f465670f tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ffacb693-f01c-4195-bf3a-bf76f465670f tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065061 Apr 14 15:43:08 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 127/376] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:43:08 2023] GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:08 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-b657dddb-d25a-4d25-a83e-f5b35ee01d43 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:08 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-b657dddb-d25a-4d25-a83e-f5b35ee01d43 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:08 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-b657dddb-d25a-4d25-a83e-f5b35ee01d43 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:08 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-b657dddb-d25a-4d25-a83e-f5b35ee01d43 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" status: 200 len: 1754 microversion: 2.87 time: 0.739401 Apr 14 15:43:08 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 126/377] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:43:08 2023] GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => generated 1754 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:43:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-35cb0bef-1272-4661-bc0a-40ac1f9b748f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:09 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-35cb0bef-1272-4661-bc0a-40ac1f9b748f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-35cb0bef-1272-4661-bc0a-40ac1f9b748f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-35cb0bef-1272-4661-bc0a-40ac1f9b748f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-35cb0bef-1272-4661-bc0a-40ac1f9b748f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-35cb0bef-1272-4661-bc0a-40ac1f9b748f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-35cb0bef-1272-4661-bc0a-40ac1f9b748f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-35cb0bef-1272-4661-bc0a-40ac1f9b748f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:10 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-35cb0bef-1272-4661-bc0a-40ac1f9b748f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af824b840c604223afd90bce17fe1ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e73ef2ad94e84876def53ddf43da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:10 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-35cb0bef-1272-4661-bc0a-40ac1f9b748f tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a" status: 200 len: 1494 microversion: 2.1 time: 0.270981 Apr 14 15:43:10 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 125/378] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:43:09 2023] GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a => generated 1494 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:43:10 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc81318c-1157-4832-919a-28cc14431f48", "tag": "3f7d69ad-aaff-498b-8862-241238c91a38"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] Creating event network-changed:3f7d69ad-aaff-498b-8862-241238c91a38 for instance cc81318c-1157-4832-919a-28cc14431f48 on user Apr 14 15:43:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030420 Apr 14 15:43:10 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 128/379] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:11 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3b62b65b-7ceb-47a9-a785-08e1ad056ecb tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Action: 'create', calling method: .version_select at 0x7f2970bda680>, body: {"keypair": {"name": "tempest-TestStampPattern-1517680664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4sU0e1aWgzZS4MOB5AT/CZgk6WpHTA+r2izVYI4qYQDQedY8SJh36x9vWqTx80kNrABeizIWC0TbVPD+u2KOJhSvC9hs1DN58Hn4LwYWJ1aMAaGoYLSrV75oncnEyg+Q=="}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:11 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-3b62b65b-7ceb-47a9-a785-08e1ad056ecb tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Getting quotas for project d1ac7fb012e144cdaa7da36ee9b590a0. Resources: {'key_pairs'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:43:11 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-3b62b65b-7ceb-47a9-a785-08e1ad056ecb tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Getting quotas for user 855c585696694964974a8df948ab7899 and project d1ac7fb012e144cdaa7da36ee9b590a0. Resources: {'key_pairs'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:43:11 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-3b62b65b-7ceb-47a9-a785-08e1ad056ecb tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.221686 Apr 14 15:43:11 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 127/380] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 15:43:11 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:43:12 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-6adf55f3-a3c3-46c7-b933-bdeb8831c73b req-854df07d-7469-47cb-98df-395c575ab703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc81318c-1157-4832-919a-28cc14431f48", "name": "network-vif-plugged", "status": "completed", "tag": "3f7d69ad-aaff-498b-8862-241238c91a38"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:12 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6adf55f3-a3c3-46c7-b933-bdeb8831c73b req-854df07d-7469-47cb-98df-395c575ab703 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:12 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6adf55f3-a3c3-46c7-b933-bdeb8831c73b req-854df07d-7469-47cb-98df-395c575ab703 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:12 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6adf55f3-a3c3-46c7-b933-bdeb8831c73b req-854df07d-7469-47cb-98df-395c575ab703 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:12 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-6adf55f3-a3c3-46c7-b933-bdeb8831c73b req-854df07d-7469-47cb-98df-395c575ab703 service nova] Creating event network-vif-plugged:3f7d69ad-aaff-498b-8862-241238c91a38 for instance cc81318c-1157-4832-919a-28cc14431f48 on user Apr 14 15:43:12 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-6adf55f3-a3c3-46c7-b933-bdeb8831c73b req-854df07d-7469-47cb-98df-395c575ab703 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040259 Apr 14 15:43:12 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 126/381] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:14 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-85fcf12d-8ec8-4058-877f-484e13e2b8d4 req-abb31d74-9b72-482a-bef8-189e68ea58d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc81318c-1157-4832-919a-28cc14431f48", "name": "network-vif-plugged", "status": "completed", "tag": "3f7d69ad-aaff-498b-8862-241238c91a38"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-85fcf12d-8ec8-4058-877f-484e13e2b8d4 req-abb31d74-9b72-482a-bef8-189e68ea58d1 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-85fcf12d-8ec8-4058-877f-484e13e2b8d4 req-abb31d74-9b72-482a-bef8-189e68ea58d1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-85fcf12d-8ec8-4058-877f-484e13e2b8d4 req-abb31d74-9b72-482a-bef8-189e68ea58d1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:14 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-85fcf12d-8ec8-4058-877f-484e13e2b8d4 req-abb31d74-9b72-482a-bef8-189e68ea58d1 service nova] Creating event network-vif-plugged:3f7d69ad-aaff-498b-8862-241238c91a38 for instance cc81318c-1157-4832-919a-28cc14431f48 on user Apr 14 15:43:14 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-85fcf12d-8ec8-4058-877f-484e13e2b8d4 req-abb31d74-9b72-482a-bef8-189e68ea58d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058139 Apr 14 15:43:14 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 129/382] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:15 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-915600654", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1517680664", "security_groups": [{"name": "tempest-secgroup-smoke-1075360313"}], "networks": [{"uuid": "ede18487-777c-44d7-94ad-f2452fbc753e"}]}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] validate_networks() for [('ede18487-777c-44d7-94ad-f2452fbc753e', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Getting quotas for project d1ac7fb012e144cdaa7da36ee9b590a0. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Getting quotas for user 855c585696694964974a8df948ab7899 and project d1ac7fb012e144cdaa7da36ee9b590a0. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:43:16 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:43:16 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.699319 Apr 14 15:43:16 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 128/383] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:43:15 2023] POST /compute/v2.1/servers => generated 404 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:43:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6c457db8-9086-4980-a9aa-240f6c686c79 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:16 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-6c457db8-9086-4980-a9aa-240f6c686c79 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:16 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-6c457db8-9086-4980-a9aa-240f6c686c79 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855c585696694964974a8df948ab7899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac7fb012e144cdaa7da36ee9b590a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-6c457db8-9086-4980-a9aa-240f6c686c79 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60" status: 200 len: 1236 microversion: 2.1 time: 0.079852 Apr 14 15:43:16 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 127/384] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:43:16 2023] GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:43:19 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:19 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203e4039-aa71-4521-8e74-02452436cb60", "tag": "59970400-49c0-4153-85a7-7b9b9496df26"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:19 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] Creating event network-changed:59970400-49c0-4153-85a7-7b9b9496df26 for instance 203e4039-aa71-4521-8e74-02452436cb60 on user Apr 14 15:43:19 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032759 Apr 14 15:43:19 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 130/385] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:20 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-83e89036-9767-4b70-a168-5d6772052c04 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:20 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-83e89036-9767-4b70-a168-5d6772052c04 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-83e89036-9767-4b70-a168-5d6772052c04 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-83e89036-9767-4b70-a168-5d6772052c04 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-83e89036-9767-4b70-a168-5d6772052c04 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-83e89036-9767-4b70-a168-5d6772052c04 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-83e89036-9767-4b70-a168-5d6772052c04 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-83e89036-9767-4b70-a168-5d6772052c04 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:20 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-83e89036-9767-4b70-a168-5d6772052c04 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-83e89036-9767-4b70-a168-5d6772052c04 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36" status: 200 len: 1537 microversion: 2.1 time: 0.332878 Apr 14 15:43:20 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 129/386] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:43:20 2023] GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36 => generated 1537 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:43:20 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-5b94c6a3-83a3-4257-ad59-f344a1972aee tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:20 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-5b94c6a3-83a3-4257-ad59-f344a1972aee tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:20 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-5b94c6a3-83a3-4257-ad59-f344a1972aee tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Searching by: {'deleted': False, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb'} {{(pid=61875) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 15:43:20 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b94c6a3-83a3-4257-ad59-f344a1972aee tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b94c6a3-83a3-4257-ad59-f344a1972aee tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b94c6a3-83a3-4257-ad59-f344a1972aee tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b94c6a3-83a3-4257-ad59-f344a1972aee tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b94c6a3-83a3-4257-ad59-f344a1972aee tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b94c6a3-83a3-4257-ad59-f344a1972aee tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:21 user devstack@n-api.service[61875]: DEBUG nova.compute.multi_cell_list [None req-5b94c6a3-83a3-4257-ad59-f344a1972aee tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 15:43:21 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-5b94c6a3-83a3-4257-ad59-f344a1972aee tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.197156 Apr 14 15:43:21 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 128/387] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 15:43:20 2023] GET /compute/v2.1/servers => generated 341 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:21 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6f6da497-2b3f-467e-8562-04976fae2c85 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:21 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-6f6da497-2b3f-467e-8562-04976fae2c85 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6f6da497-2b3f-467e-8562-04976fae2c85 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6f6da497-2b3f-467e-8562-04976fae2c85 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6f6da497-2b3f-467e-8562-04976fae2c85 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6f6da497-2b3f-467e-8562-04976fae2c85 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6f6da497-2b3f-467e-8562-04976fae2c85 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6f6da497-2b3f-467e-8562-04976fae2c85 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:21 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-6f6da497-2b3f-467e-8562-04976fae2c85 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6f6da497-2b3f-467e-8562-04976fae2c85 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36" status: 200 len: 1537 microversion: 2.1 time: 0.276117 Apr 14 15:43:21 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 131/388] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:43:21 2023] GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36 => generated 1537 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:43:21 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-f250a4c0-95f5-45e7-ada1-4fcc6402327a req-a47d8d75-f848-4973-9e33-5ff9db560b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203e4039-aa71-4521-8e74-02452436cb60", "name": "network-vif-plugged", "status": "completed", "tag": "59970400-49c0-4153-85a7-7b9b9496df26"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f250a4c0-95f5-45e7-ada1-4fcc6402327a req-a47d8d75-f848-4973-9e33-5ff9db560b76 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f250a4c0-95f5-45e7-ada1-4fcc6402327a req-a47d8d75-f848-4973-9e33-5ff9db560b76 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f250a4c0-95f5-45e7-ada1-4fcc6402327a req-a47d8d75-f848-4973-9e33-5ff9db560b76 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:21 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-f250a4c0-95f5-45e7-ada1-4fcc6402327a req-a47d8d75-f848-4973-9e33-5ff9db560b76 service nova] Creating event network-vif-plugged:59970400-49c0-4153-85a7-7b9b9496df26 for instance 203e4039-aa71-4521-8e74-02452436cb60 on user Apr 14 15:43:21 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-f250a4c0-95f5-45e7-ada1-4fcc6402327a req-a47d8d75-f848-4973-9e33-5ff9db560b76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030861 Apr 14 15:43:21 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 130/389] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:22 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a57cff77-34aa-4e2b-aa17-7b4a9a4ebfa4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3472630f-da06-4df5-8bc3-c9f9b0a01c3d"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:22 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a57cff77-34aa-4e2b-aa17-7b4a9a4ebfa4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a57cff77-34aa-4e2b-aa17-7b4a9a4ebfa4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a57cff77-34aa-4e2b-aa17-7b4a9a4ebfa4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a57cff77-34aa-4e2b-aa17-7b4a9a4ebfa4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a57cff77-34aa-4e2b-aa17-7b4a9a4ebfa4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a57cff77-34aa-4e2b-aa17-7b4a9a4ebfa4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a57cff77-34aa-4e2b-aa17-7b4a9a4ebfa4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:22 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-a57cff77-34aa-4e2b-aa17-7b4a9a4ebfa4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 0f27f459-5b11-4564-ab4c-7194b18319f4 while it is in vm_state rescued Apr 14 15:43:22 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a57cff77-34aa-4e2b-aa17-7b4a9a4ebfa4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Request method failure captured: Apr 14 15:43:22 user devstack@n-api.service[61875]: request: POST /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4/os-volume_attachments HTTP/1.1 Apr 14 15:43:22 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:43:22 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:43:22 user devstack@n-api.service[61875]: Connection: close Apr 14 15:43:22 user devstack@n-api.service[61875]: Content-Length: 74 Apr 14 15:43:22 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:43:22 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:43:22 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:43:22 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXMKxzbBhP_wAtg_GdyJNNrWMR04NHs8zgKICtljO-nO6YTCpgo2vyufA6TA9obkNQP1BDx8dqjHFzo_6wx95XvZIjeEaJUUrM_1TVkjKaYmi4C7vK-xA49gMl_SHFlLmsp5h9mS72_mB06A8lcnKv1B72X0XrCUIHCQChJFUCLD5SA Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Project-Id: 609ac7b149e14baab270d83a2646fbdf Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Tenant-Id: 609ac7b149e14baab270d83a2646fbdf Apr 14 15:43:22 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:43:22 user devstack@n-api.service[61875]: X-User: tempest-ServerRescueNegativeTestJSON-1174024196-project-member Apr 14 15:43:22 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:43:22 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:43:22 user devstack@n-api.service[61875]: X-User-Id: 3fa924fefda1428d81152fd573540f26 Apr 14 15:43:22 user devstack@n-api.service[61875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1174024196-project-member Apr 14 15:43:22 user devstack@n-api.service[61875]: Apr 14 15:43:22 user devstack@n-api.service[61875]: {"volumeAttachment": {"volumeId": "3472630f-da06-4df5-8bc3-c9f9b0a01c3d"}} Apr 14 15:43:22 user devstack@n-api.service[61875]: method: > Apr 14 15:43:22 user devstack@n-api.service[61875]: exception: Cannot 'attach_volume' instance 0f27f459-5b11-4564-ab4c-7194b18319f4 while it is in vm_state rescued Apr 14 15:43:22 user devstack@n-api.service[61875]: action_args: {'server_id': '0f27f459-5b11-4564-ab4c-7194b18319f4', 'body': {'volumeAttachment': {'volumeId': '3472630f-da06-4df5-8bc3-c9f9b0a01c3d'}}} Apr 14 15:43:22 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0f27f459-5b11-4564-ab4c-7194b18319f4 while it is in vm_state rescued Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0f27f459-5b11-4564-ab4c-7194b18319f4 while it is in vm_state rescued Apr 14 15:43:22 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:43:22 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a57cff77-34aa-4e2b-aa17-7b4a9a4ebfa4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Returning 409 to user: Cannot 'attach_volume' instance 0f27f459-5b11-4564-ab4c-7194b18319f4 while it is in vm_state rescued {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:43:22 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a57cff77-34aa-4e2b-aa17-7b4a9a4ebfa4 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043764 Apr 14 15:43:22 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 129/390] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:43:22 2023] POST /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 15:43:22 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:22 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:22 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4/action" status: 202 len: 0 microversion: 2.1 time: 0.075416 Apr 14 15:43:22 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 132/391] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:43:22 2023] POST /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:43:23 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-42fdf20f-1f07-4934-a8eb-a94bfcf4e08f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:23 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-42fdf20f-1f07-4934-a8eb-a94bfcf4e08f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-42fdf20f-1f07-4934-a8eb-a94bfcf4e08f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-42fdf20f-1f07-4934-a8eb-a94bfcf4e08f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-42fdf20f-1f07-4934-a8eb-a94bfcf4e08f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-42fdf20f-1f07-4934-a8eb-a94bfcf4e08f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-42fdf20f-1f07-4934-a8eb-a94bfcf4e08f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-42fdf20f-1f07-4934-a8eb-a94bfcf4e08f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:23 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-42fdf20f-1f07-4934-a8eb-a94bfcf4e08f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:23 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-42fdf20f-1f07-4934-a8eb-a94bfcf4e08f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4" status: 200 len: 1496 microversion: 2.1 time: 0.255382 Apr 14 15:43:23 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 131/392] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:43:22 2023] GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4 => generated 1496 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:43:23 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-0c058b6f-21e6-489d-a78b-ae431bcdc78f req-0b2f118c-cd20-4658-b2c1-80e0a71b233e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "name": "network-vif-unplugged", "status": "completed", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:23 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0c058b6f-21e6-489d-a78b-ae431bcdc78f req-0b2f118c-cd20-4658-b2c1-80e0a71b233e service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:23 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0c058b6f-21e6-489d-a78b-ae431bcdc78f req-0b2f118c-cd20-4658-b2c1-80e0a71b233e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:23 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0c058b6f-21e6-489d-a78b-ae431bcdc78f req-0b2f118c-cd20-4658-b2c1-80e0a71b233e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:23 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-0c058b6f-21e6-489d-a78b-ae431bcdc78f req-0b2f118c-cd20-4658-b2c1-80e0a71b233e service nova] Creating event network-vif-unplugged:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:43:23 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-0c058b6f-21e6-489d-a78b-ae431bcdc78f req-0b2f118c-cd20-4658-b2c1-80e0a71b233e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060518 Apr 14 15:43:23 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 130/393] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:43:23 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-cb0f4f14-b165-4034-a4e6-7b95f918aead req-fcac4262-1175-433b-bf17-d6891052f4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203e4039-aa71-4521-8e74-02452436cb60", "name": "network-vif-plugged", "status": "completed", "tag": "59970400-49c0-4153-85a7-7b9b9496df26"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-cb0f4f14-b165-4034-a4e6-7b95f918aead req-fcac4262-1175-433b-bf17-d6891052f4c8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-cb0f4f14-b165-4034-a4e6-7b95f918aead req-fcac4262-1175-433b-bf17-d6891052f4c8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-cb0f4f14-b165-4034-a4e6-7b95f918aead req-fcac4262-1175-433b-bf17-d6891052f4c8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-cb0f4f14-b165-4034-a4e6-7b95f918aead req-fcac4262-1175-433b-bf17-d6891052f4c8 service nova] Creating event network-vif-plugged:59970400-49c0-4153-85a7-7b9b9496df26 for instance 203e4039-aa71-4521-8e74-02452436cb60 on user Apr 14 15:43:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-cb0f4f14-b165-4034-a4e6-7b95f918aead req-fcac4262-1175-433b-bf17-d6891052f4c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032979 Apr 14 15:43:23 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 133/394] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:24 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25aefab3-a41b-41a7-bc7c-4f07017f7305"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:24 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:24 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284722 Apr 14 15:43:24 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 132/395] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:43:24 2023] POST /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:25 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "name": "network-vif-plugged", "status": "completed", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}, {"server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "name": "network-vif-plugged", "status": "completed", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] Creating event network-vif-plugged:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:43:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] Creating event network-vif-plugged:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:43:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038376 Apr 14 15:43:25 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 131/396] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:27 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-6c944ccb-2b48-4880-b8ee-c4966a16ff55 req-289e4df6-66c4-4421-8dc3-46d71571ada5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "name": "network-vif-plugged", "status": "completed", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=23 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6c944ccb-2b48-4880-b8ee-c4966a16ff55 req-289e4df6-66c4-4421-8dc3-46d71571ada5 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6c944ccb-2b48-4880-b8ee-c4966a16ff55 req-289e4df6-66c4-4421-8dc3-46d71571ada5 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6c944ccb-2b48-4880-b8ee-c4966a16ff55 req-289e4df6-66c4-4421-8dc3-46d71571ada5 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-6c944ccb-2b48-4880-b8ee-c4966a16ff55 req-289e4df6-66c4-4421-8dc3-46d71571ada5 service nova] Creating event network-vif-plugged:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:43:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-6c944ccb-2b48-4880-b8ee-c4966a16ff55 req-289e4df6-66c4-4421-8dc3-46d71571ada5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035453 Apr 14 15:43:28 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 134/397] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:35 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:35 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=14 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:35 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:35 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:35 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-b80846c8-e2bd-48ed-a12e-cdb1fc2c273d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:35 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-b80846c8-e2bd-48ed-a12e-cdb1fc2c273d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b80846c8-e2bd-48ed-a12e-cdb1fc2c273d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b80846c8-e2bd-48ed-a12e-cdb1fc2c273d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b80846c8-e2bd-48ed-a12e-cdb1fc2c273d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b80846c8-e2bd-48ed-a12e-cdb1fc2c273d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b80846c8-e2bd-48ed-a12e-cdb1fc2c273d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b80846c8-e2bd-48ed-a12e-cdb1fc2c273d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:35 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-b80846c8-e2bd-48ed-a12e-cdb1fc2c273d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:35 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-b80846c8-e2bd-48ed-a12e-cdb1fc2c273d tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36" status: 200 len: 1583 microversion: 2.1 time: 0.313503 Apr 14 15:43:35 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 133/398] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:43:35 2023] GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36 => generated 1583 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:43:36 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=8 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:36 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:36 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:36 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:36 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-1b75412e-57d2-40eb-a7f8-9f1f02154081 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:36 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-1b75412e-57d2-40eb-a7f8-9f1f02154081 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1b75412e-57d2-40eb-a7f8-9f1f02154081 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1b75412e-57d2-40eb-a7f8-9f1f02154081 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1b75412e-57d2-40eb-a7f8-9f1f02154081 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1b75412e-57d2-40eb-a7f8-9f1f02154081 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1b75412e-57d2-40eb-a7f8-9f1f02154081 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1b75412e-57d2-40eb-a7f8-9f1f02154081 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:36 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-1b75412e-57d2-40eb-a7f8-9f1f02154081 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-1b75412e-57d2-40eb-a7f8-9f1f02154081 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1657 microversion: 2.1 time: 0.364744 Apr 14 15:43:36 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 132/399] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:43:36 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1657 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:43:36 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-a7823722-372c-4255-8ff0-c75518ac5fc9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:36 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-a7823722-372c-4255-8ff0-c75518ac5fc9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a7823722-372c-4255-8ff0-c75518ac5fc9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a7823722-372c-4255-8ff0-c75518ac5fc9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a7823722-372c-4255-8ff0-c75518ac5fc9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a7823722-372c-4255-8ff0-c75518ac5fc9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a7823722-372c-4255-8ff0-c75518ac5fc9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a7823722-372c-4255-8ff0-c75518ac5fc9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:37 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-a7823722-372c-4255-8ff0-c75518ac5fc9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:37 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-a7823722-372c-4255-8ff0-c75518ac5fc9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1657 microversion: 2.1 time: 0.210757 Apr 14 15:43:37 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 135/400] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:43:36 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1657 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:43:38 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:38 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] Creating event network-changed:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:43:38 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031607 Apr 14 15:43:38 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 134/401] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:39 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-e30fe6d5-1483-482b-8c01-1f87b71da511 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1244790362"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:39 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-e30fe6d5-1483-482b-8c01-1f87b71da511 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e30fe6d5-1483-482b-8c01-1f87b71da511 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e30fe6d5-1483-482b-8c01-1f87b71da511 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e30fe6d5-1483-482b-8c01-1f87b71da511 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e30fe6d5-1483-482b-8c01-1f87b71da511 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e30fe6d5-1483-482b-8c01-1f87b71da511 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e30fe6d5-1483-482b-8c01-1f87b71da511 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:40 user devstack@n-api.service[61875]: INFO nova.network.security_group_api [None req-e30fe6d5-1483-482b-8c01-1f87b71da511 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Adding security group 724ba491-cc3e-4c14-83ea-9025d5fd9e0d to port 05127b2a-2e86-4f6a-9fb3-9e2be5559bde Apr 14 15:43:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-e30fe6d5-1483-482b-8c01-1f87b71da511 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/action" status: 202 len: 0 microversion: 2.1 time: 0.686451 Apr 14 15:43:40 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 133/402] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:43:39 2023] POST /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:43:40 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-e635fe71-f23d-45db-bca2-8495a6dc75f6 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:40 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-e635fe71-f23d-45db-bca2-8495a6dc75f6 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:40 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e635fe71-f23d-45db-bca2-8495a6dc75f6 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e635fe71-f23d-45db-bca2-8495a6dc75f6 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e635fe71-f23d-45db-bca2-8495a6dc75f6 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e635fe71-f23d-45db-bca2-8495a6dc75f6 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e635fe71-f23d-45db-bca2-8495a6dc75f6 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e635fe71-f23d-45db-bca2-8495a6dc75f6 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:40 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] Creating event network-changed:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:43:40 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030270 Apr 14 15:43:40 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 135/403] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:40 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-e635fe71-f23d-45db-bca2-8495a6dc75f6 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:40 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-e635fe71-f23d-45db-bca2-8495a6dc75f6 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36" status: 200 len: 1749 microversion: 2.1 time: 0.193590 Apr 14 15:43:40 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 136/404] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:43:40 2023] GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36 => generated 1749 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:43:44 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:44 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:44 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/action" status: 202 len: 0 microversion: 2.1 time: 0.092927 Apr 14 15:43:44 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 134/405] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:43:44 2023] POST /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:43:44 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-02df2931-2ec0-4be8-91e1-42b38b73cb9b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:44 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-02df2931-2ec0-4be8-91e1-42b38b73cb9b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-02df2931-2ec0-4be8-91e1-42b38b73cb9b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-02df2931-2ec0-4be8-91e1-42b38b73cb9b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-02df2931-2ec0-4be8-91e1-42b38b73cb9b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-02df2931-2ec0-4be8-91e1-42b38b73cb9b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-02df2931-2ec0-4be8-91e1-42b38b73cb9b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-02df2931-2ec0-4be8-91e1-42b38b73cb9b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:44 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-02df2931-2ec0-4be8-91e1-42b38b73cb9b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:44 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-02df2931-2ec0-4be8-91e1-42b38b73cb9b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36" status: 200 len: 1751 microversion: 2.1 time: 0.251243 Apr 14 15:43:44 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 136/406] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:43:44 2023] GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36 => generated 1751 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:43:45 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-5710df52-3627-4881-ab2f-2eaf8f42d66e req-adeec8a5-b6bf-422e-a445-e3f404736970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "name": "network-vif-unplugged", "status": "completed", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-5710df52-3627-4881-ab2f-2eaf8f42d66e req-adeec8a5-b6bf-422e-a445-e3f404736970 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-5710df52-3627-4881-ab2f-2eaf8f42d66e req-adeec8a5-b6bf-422e-a445-e3f404736970 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:45 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-5710df52-3627-4881-ab2f-2eaf8f42d66e req-adeec8a5-b6bf-422e-a445-e3f404736970 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:45 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-5710df52-3627-4881-ab2f-2eaf8f42d66e req-adeec8a5-b6bf-422e-a445-e3f404736970 service nova] Creating event network-vif-unplugged:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:43:45 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-5710df52-3627-4881-ab2f-2eaf8f42d66e req-adeec8a5-b6bf-422e-a445-e3f404736970 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035271 Apr 14 15:43:45 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 137/407] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:47 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-c6864025-4eee-4c66-a2d9-ec76cd3a3e1e req-274f8369-7fd7-4d50-896a-c7ffcaf2a318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "name": "network-vif-plugged", "status": "completed", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c6864025-4eee-4c66-a2d9-ec76cd3a3e1e req-274f8369-7fd7-4d50-896a-c7ffcaf2a318 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c6864025-4eee-4c66-a2d9-ec76cd3a3e1e req-274f8369-7fd7-4d50-896a-c7ffcaf2a318 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c6864025-4eee-4c66-a2d9-ec76cd3a3e1e req-274f8369-7fd7-4d50-896a-c7ffcaf2a318 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:47 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c6864025-4eee-4c66-a2d9-ec76cd3a3e1e req-274f8369-7fd7-4d50-896a-c7ffcaf2a318 service nova] Creating event network-vif-plugged:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:43:47 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-c6864025-4eee-4c66-a2d9-ec76cd3a3e1e req-274f8369-7fd7-4d50-896a-c7ffcaf2a318 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032075 Apr 14 15:43:47 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 135/408] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:47 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2d6ddde7-f2a2-4ff7-83c0-258066790fa6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:47 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-2d6ddde7-f2a2-4ff7-83c0-258066790fa6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2d6ddde7-f2a2-4ff7-83c0-258066790fa6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2d6ddde7-f2a2-4ff7-83c0-258066790fa6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2d6ddde7-f2a2-4ff7-83c0-258066790fa6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2d6ddde7-f2a2-4ff7-83c0-258066790fa6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2d6ddde7-f2a2-4ff7-83c0-258066790fa6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2d6ddde7-f2a2-4ff7-83c0-258066790fa6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:47 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-2d6ddde7-f2a2-4ff7-83c0-258066790fa6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] HTTP exception thrown: Instance f094302b-0730-4754-b9e9-ec203312b8c0 could not be found. Apr 14 15:43:47 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2d6ddde7-f2a2-4ff7-83c0-258066790fa6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Request method failure captured: Apr 14 15:43:47 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0 HTTP/1.1 Apr 14 15:43:47 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:43:47 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:43:47 user devstack@n-api.service[61874]: Connection: close Apr 14 15:43:47 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:43:47 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:43:47 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:43:47 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:43:47 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXMNsRCbjFp3Cj5vRe0W-2HiqIYQxHk-9MpVmGCYCs2lJgB5jNIN2zlXPDz31NFQLUpJnVKwCv0dipeHdaK4qVzme-N0--J_PkaC-x6esCB5qtv21zUjwz-XvHiQcI4cMKdHe9GqgMQjEYTBMZruLRYRe4ow2rkrVw4Zv0sfJFb6f3c Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Project-Id: 029b8c395f264a86933a9e878c18e0b2 Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Project-Name: tempest-VolumesAdminNegativeTest-1127532 Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/029b8c395f264a86933a9e878c18e0b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/029b8c395f264a86933a9e878c18e0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/029b8c395f264a86933a9e878c18e0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Tenant: tempest-VolumesAdminNegativeTest-1127532 Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Tenant-Id: 029b8c395f264a86933a9e878c18e0b2 Apr 14 15:43:47 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1127532 Apr 14 15:43:47 user devstack@n-api.service[61874]: X-User: tempest-VolumesAdminNegativeTest-1127532-project-member Apr 14 15:43:47 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:43:47 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:43:47 user devstack@n-api.service[61874]: X-User-Id: e1aa921f86bd4f3b88eb782d5f667816 Apr 14 15:43:47 user devstack@n-api.service[61874]: X-User-Name: tempest-VolumesAdminNegativeTest-1127532-project-member Apr 14 15:43:47 user devstack@n-api.service[61874]: method: > Apr 14 15:43:47 user devstack@n-api.service[61874]: exception: Instance f094302b-0730-4754-b9e9-ec203312b8c0 could not be found. Apr 14 15:43:47 user devstack@n-api.service[61874]: action_args: {'id': 'f094302b-0730-4754-b9e9-ec203312b8c0'} Apr 14 15:43:47 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f094302b-0730-4754-b9e9-ec203312b8c0 could not be found. Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f094302b-0730-4754-b9e9-ec203312b8c0 could not be found. Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f094302b-0730-4754-b9e9-ec203312b8c0 could not be found. Apr 14 15:43:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:43:47 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2d6ddde7-f2a2-4ff7-83c0-258066790fa6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Returning 404 to user: Instance f094302b-0730-4754-b9e9-ec203312b8c0 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:43:47 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-2d6ddde7-f2a2-4ff7-83c0-258066790fa6 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0" status: 404 len: 111 microversion: 2.1 time: 0.027124 Apr 14 15:43:47 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 137/409] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:43:47 2023] GET /compute/v2.1/servers/f094302b-0730-4754-b9e9-ec203312b8c0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:43:47 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-3f1e903b-c327-4b02-99fd-e6578bc154c4 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Calling method '.version_select at 0x7f2970941cf0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:47 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-3f1e903b-c327-4b02-99fd-e6578bc154c4 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028605759" status: 202 len: 0 microversion: 2.1 time: 0.025895 Apr 14 15:43:47 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 138/410] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 15:43:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028605759 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:43:49 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-7c67ee54-8184-4808-8849-d95276c300aa req-d8639d12-1011-478a-bf6a-02fab7c120e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "name": "network-vif-plugged", "status": "completed", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7c67ee54-8184-4808-8849-d95276c300aa req-d8639d12-1011-478a-bf6a-02fab7c120e4 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7c67ee54-8184-4808-8849-d95276c300aa req-d8639d12-1011-478a-bf6a-02fab7c120e4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7c67ee54-8184-4808-8849-d95276c300aa req-d8639d12-1011-478a-bf6a-02fab7c120e4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-7c67ee54-8184-4808-8849-d95276c300aa req-d8639d12-1011-478a-bf6a-02fab7c120e4 service nova] Creating event network-vif-plugged:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:43:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-7c67ee54-8184-4808-8849-d95276c300aa req-d8639d12-1011-478a-bf6a-02fab7c120e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028683 Apr 14 15:43:49 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 136/411] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:51 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-8d3eb578-a271-4547-b495-91ed6c7a1f5d req-9986f8c9-c683-4b32-8660-0e7d41755974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "name": "network-vif-plugged", "status": "completed", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-8d3eb578-a271-4547-b495-91ed6c7a1f5d req-9986f8c9-c683-4b32-8660-0e7d41755974 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-8d3eb578-a271-4547-b495-91ed6c7a1f5d req-9986f8c9-c683-4b32-8660-0e7d41755974 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-8d3eb578-a271-4547-b495-91ed6c7a1f5d req-9986f8c9-c683-4b32-8660-0e7d41755974 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:51 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-8d3eb578-a271-4547-b495-91ed6c7a1f5d req-9986f8c9-c683-4b32-8660-0e7d41755974 service nova] Creating event network-vif-plugged:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:43:51 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-8d3eb578-a271-4547-b495-91ed6c7a1f5d req-9986f8c9-c683-4b32-8660-0e7d41755974 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Apr 14 15:43:51 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 138/412] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:43:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:56 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=15 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:56 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-2c637d67-019d-4bfb-be25-0a9542c44e0b tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Action: 'create', calling method: .version_select at 0x7f2970aa1900>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-761441127"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:56 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-2c637d67-019d-4bfb-be25-0a9542c44e0b tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.445427 Apr 14 15:43:56 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 139/413] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 14 15:43:56 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 447 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 15:43:56 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a8efb6c6-ef75-4a3e-a833-c147f2e5c728 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970a45e10>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a8efb6c6-ef75-4a3e-a833-c147f2e5c728 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71" status: 200 len: 344 microversion: 2.1 time: 0.054934 Apr 14 15:43:56 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 137/414] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:43:56 2023] GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:57 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-a35e6361-a5ca-4528-ba72-842905a959c2 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:57 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-a35e6361-a5ca-4528-ba72-842905a959c2 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a35e6361-a5ca-4528-ba72-842905a959c2 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a35e6361-a5ca-4528-ba72-842905a959c2 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a35e6361-a5ca-4528-ba72-842905a959c2 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a35e6361-a5ca-4528-ba72-842905a959c2 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a35e6361-a5ca-4528-ba72-842905a959c2 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a35e6361-a5ca-4528-ba72-842905a959c2 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:57 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:43:57 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-692a144b-bcad-47b9-a0bf-d1a2f9468d65 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970942680>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:57 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-a35e6361-a5ca-4528-ba72-842905a959c2 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee063f686de4a9f9e6b5fe1e7ce2c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737ea257ab5448389bd751841be0fc72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:43:57 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-692a144b-bcad-47b9-a0bf-d1a2f9468d65 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71" status: 200 len: 344 microversion: 2.1 time: 0.054241 Apr 14 15:43:57 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 140/415] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:43:57 2023] GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:57 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-a35e6361-a5ca-4528-ba72-842905a959c2 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48" status: 200 len: 1569 microversion: 2.1 time: 0.252894 Apr 14 15:43:57 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 139/416] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:43:57 2023] GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48 => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:43:58 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6d14cbb2-7273-44f4-986a-dac6cad27825 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:58 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-6d14cbb2-7273-44f4-986a-dac6cad27825 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:43:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6d14cbb2-7273-44f4-986a-dac6cad27825 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6d14cbb2-7273-44f4-986a-dac6cad27825 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6d14cbb2-7273-44f4-986a-dac6cad27825 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6d14cbb2-7273-44f4-986a-dac6cad27825 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:43:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6d14cbb2-7273-44f4-986a-dac6cad27825 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:43:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6d14cbb2-7273-44f4-986a-dac6cad27825 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:43:58 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-6d14cbb2-7273-44f4-986a-dac6cad27825 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043602 Apr 14 15:43:58 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 138/417] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:43:58 2023] GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:43:58 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-e9328bf6-f5f5-4dc5-a19b-a5459d1b3cbc tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f29709ce0e0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:58 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-e9328bf6-f5f5-4dc5-a19b-a5459d1b3cbc tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71" status: 200 len: 345 microversion: 2.1 time: 0.092332 Apr 14 15:43:58 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 141/418] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:43:58 2023] GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71 => generated 345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2a4e9a6f-2bc1-4e12-a7d9-547a66f48cb8 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Action: 'create', calling method: .version_select at 0x7f2970bd93f0>, body: {"snapshot": {"volume_id": "e61518af-544a-49c2-b0f4-a839e16c3b71", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-496502592"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:43:59 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-2a4e9a6f-2bc1-4e12-a7d9-547a66f48cb8 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.166786 Apr 14 15:43:59 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 140/419] 10.0.0.210 () {64 vars in 1239 bytes} [Fri Apr 14 15:43:58 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:59 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-4821c306-de65-4853-ac54-5d5387657a5c tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970ccd990>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:59 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-4821c306-de65-4853-ac54-5d5387657a5c tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a" status: 200 len: 286 microversion: 2.1 time: 0.037536 Apr 14 15:43:59 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 139/420] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 15:43:59 2023] GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:59 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-0606b887-2297-4a56-b191-fa7db8d3631e tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970942d40>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:59 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-0606b887-2297-4a56-b191-fa7db8d3631e tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.062361 Apr 14 15:43:59 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 142/421] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 15:43:59 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:43:59 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-75f28741-e594-463b-a8fd-1694012b21c6 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f297094c700>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:43:59 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-75f28741-e594-463b-a8fd-1694012b21c6 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a" status: 200 len: 286 microversion: 2.1 time: 0.038249 Apr 14 15:43:59 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 141/422] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 15:43:59 2023] GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:00 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-dbb5adb7-18eb-4a92-9ec4-b117d02f14be tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970943be0>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:00 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-dbb5adb7-18eb-4a92-9ec4-b117d02f14be tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a" status: 200 len: 286 microversion: 2.1 time: 0.038488 Apr 14 15:44:00 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 140/423] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 15:44:00 2023] GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:01 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ca155bfa-b7c5-4358-a335-23009abdc307 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970aa1c60>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ca155bfa-b7c5-4358-a335-23009abdc307 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a" status: 200 len: 286 microversion: 2.1 time: 0.061533 Apr 14 15:44:01 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 143/424] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 15:44:01 2023] GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:02 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-49c03462-3057-496d-b429-1b87826f7b4b tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '.version_select at 0x7f2970bd8e50>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:02 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-49c03462-3057-496d-b429-1b87826f7b4b tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/c1382ef4-ea4d-4bc8-a660-6abf260444d7" status: 204 len: 0 microversion: 2.1 time: 0.273394 Apr 14 15:44:02 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 142/425] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:44:02 2023] DELETE /compute/v2.1/images/c1382ef4-ea4d-4bc8-a660-6abf260444d7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:44:02 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-288665ac-1e55-48ef-bea3-ad6c46aba85b tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970942290>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:02 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:02 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-288665ac-1e55-48ef-bea3-ad6c46aba85b tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a" status: 200 len: 287 microversion: 2.1 time: 0.050310 Apr 14 15:44:02 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 141/426] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 15:44:02 2023] GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:02 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Going to try to terminate instance {{(pid=61876) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:44:02 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-59284c36-a9fa-494c-a91d-7f6a556b74dc tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970bd9bd0>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:02 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed" status: 204 len: 0 microversion: 2.1 time: 0.148415 Apr 14 15:44:02 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 144/427] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:44:02 2023] DELETE /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:44:02 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-4bbb2a9d-7f86-4759-9748-38030e0a9121 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:02 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-4bbb2a9d-7f86-4759-9748-38030e0a9121 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bbb2a9d-7f86-4759-9748-38030e0a9121 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bbb2a9d-7f86-4759-9748-38030e0a9121 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:02 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-59284c36-a9fa-494c-a91d-7f6a556b74dc tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a" status: 202 len: 0 microversion: 2.1 time: 0.116805 Apr 14 15:44:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bbb2a9d-7f86-4759-9748-38030e0a9121 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:02 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 143/428] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 15:44:02 2023] DELETE /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:44:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bbb2a9d-7f86-4759-9748-38030e0a9121 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bbb2a9d-7f86-4759-9748-38030e0a9121 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bbb2a9d-7f86-4759-9748-38030e0a9121 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:02 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-d4824d0d-787b-48cf-8906-98fbd7025cf6 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970942440>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:02 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-d4824d0d-787b-48cf-8906-98fbd7025cf6 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a" status: 200 len: 286 microversion: 2.1 time: 0.079616 Apr 14 15:44:02 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 145/429] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 15:44:02 2023] GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:02 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-4bbb2a9d-7f86-4759-9748-38030e0a9121 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f805db20d87d4429981c975ebd88ed92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8230c5386464f288fd783b3c60536b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-4bbb2a9d-7f86-4759-9748-38030e0a9121 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed" status: 200 len: 1675 microversion: 2.1 time: 0.303083 Apr 14 15:44:02 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 142/430] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:44:02 2023] GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed => generated 1675 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:44:02 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-b360709b-332b-40ab-94e3-e5b1b70effee req-98c285ab-9e9b-4f5e-9fd8-ae9779290ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-unplugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:44:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b360709b-332b-40ab-94e3-e5b1b70effee req-98c285ab-9e9b-4f5e-9fd8-ae9779290ba6 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b360709b-332b-40ab-94e3-e5b1b70effee req-98c285ab-9e9b-4f5e-9fd8-ae9779290ba6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b360709b-332b-40ab-94e3-e5b1b70effee req-98c285ab-9e9b-4f5e-9fd8-ae9779290ba6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:02 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-b360709b-332b-40ab-94e3-e5b1b70effee req-98c285ab-9e9b-4f5e-9fd8-ae9779290ba6 service nova] Creating event network-vif-unplugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:44:02 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-b360709b-332b-40ab-94e3-e5b1b70effee req-98c285ab-9e9b-4f5e-9fd8-ae9779290ba6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037774 Apr 14 15:44:02 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 144/431] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:44:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:44:03 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-019bfdce-c8f0-4355-be90-cb62dd596d29 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f29709ccca0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:03 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-019bfdce-c8f0-4355-be90-cb62dd596d29 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a" status: 200 len: 286 microversion: 2.1 time: 0.051059 Apr 14 15:44:03 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 146/432] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 15:44:03 2023] GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:04 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-7a9369ac-f706-46bd-8847-9635338f08da tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970943d00>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-7a9369ac-f706-46bd-8847-9635338f08da tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a" status: 200 len: 286 microversion: 2.1 time: 0.034601 Apr 14 15:44:04 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 143/433] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 15:44:04 2023] GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:04 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-plugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}, {"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-plugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}, {"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-plugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}, {"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-unplugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:44:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:04 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Creating event network-vif-plugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:44:04 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Creating event network-vif-plugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:44:04 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Creating event network-vif-plugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:44:04 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Creating event network-vif-unplugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:44:05 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.039310 Apr 14 15:44:05 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 145/434] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:44:04 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:05 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-01c19bc5-93e3-4502-8a55-be14a9209c1b tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970942dd0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:05 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-01c19bc5-93e3-4502-8a55-be14a9209c1b tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] HTTP exception thrown: Snapshot eed74c6b-2258-451a-8a11-0974731e079a could not be found. Apr 14 15:44:05 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-01c19bc5-93e3-4502-8a55-be14a9209c1b tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Request method failure captured: Apr 14 15:44:05 user devstack@n-api.service[61876]: request: GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a HTTP/1.1 Apr 14 15:44:05 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:44:05 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:44:05 user devstack@n-api.service[61876]: Connection: close Apr 14 15:44:05 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:44:05 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:44:05 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:44:05 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:44:05 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXS8fSLSKbVuOF6Z8J3lb_G24kMp0SuB7fbSoeP8xtbxVmVExjiyZ3IcW7VO0NaDhBF01jfiu5u4yVIxA2e2VN58vonBxlpNfNXt5gPJODs09odZ1oPEFxXgkFkmMQ9a7l4UIuXOTPthUBzYmP4tp-rqlUouKLPktWDSNpvZdzdW15o Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Project-Id: 1eface170b884bf1af960c428a15bab1 Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1013928107 Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1eface170b884bf1af960c428a15bab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1eface170b884bf1af960c428a15bab1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1eface170b884bf1af960c428a15bab1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1013928107 Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Tenant-Id: 1eface170b884bf1af960c428a15bab1 Apr 14 15:44:05 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1013928107 Apr 14 15:44:05 user devstack@n-api.service[61876]: X-User: tempest-VolumesSnapshotsTestJSON-1013928107-project-member Apr 14 15:44:05 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:44:05 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:44:05 user devstack@n-api.service[61876]: X-User-Id: 169aa1c0d37b4ab8a315bf55cfd9f535 Apr 14 15:44:05 user devstack@n-api.service[61876]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1013928107-project-member Apr 14 15:44:05 user devstack@n-api.service[61876]: method: Apr 14 15:44:05 user devstack@n-api.service[61876]: exception: Snapshot eed74c6b-2258-451a-8a11-0974731e079a could not be found. Apr 14 15:44:05 user devstack@n-api.service[61876]: action_args: {'id': 'eed74c6b-2258-451a-8a11-0974731e079a'} Apr 14 15:44:05 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot eed74c6b-2258-451a-8a11-0974731e079a could not be found. (HTTP 404) (Request-ID: req-0c5a399b-2c75-40a2-8059-02cb5ce3de76) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot eed74c6b-2258-451a-8a11-0974731e079a could not be found. Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot eed74c6b-2258-451a-8a11-0974731e079a could not be found. Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot eed74c6b-2258-451a-8a11-0974731e079a could not be found. Apr 14 15:44:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:05 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-01c19bc5-93e3-4502-8a55-be14a9209c1b tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Returning 404 to user: Snapshot eed74c6b-2258-451a-8a11-0974731e079a could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:44:05 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-01c19bc5-93e3-4502-8a55-be14a9209c1b tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a" status: 404 len: 111 microversion: 2.1 time: 0.035259 Apr 14 15:44:05 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 147/435] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 15:44:05 2023] GET /compute/v2.1/os-snapshots/eed74c6b-2258-451a-8a11-0974731e079a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:44:05 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-80f20fe0-94b3-454a-8837-444ecf0ddf59 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970940940>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:05 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-80f20fe0-94b3-454a-8837-444ecf0ddf59 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71" status: 202 len: 0 microversion: 2.1 time: 0.070903 Apr 14 15:44:05 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 144/436] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 15:44:05 2023] DELETE /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:44:05 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-bcd6752f-9587-4bbd-a428-56ec234f06a1 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970bda290>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:05 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-bcd6752f-9587-4bbd-a428-56ec234f06a1 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71" status: 200 len: 344 microversion: 2.1 time: 0.059261 Apr 14 15:44:05 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 146/437] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:44:05 2023] GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:06 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-b8e160f1-cf75-46ad-b7ca-f8054dadf11d tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:06 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-b8e160f1-cf75-46ad-b7ca-f8054dadf11d tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b8e160f1-cf75-46ad-b7ca-f8054dadf11d tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b8e160f1-cf75-46ad-b7ca-f8054dadf11d tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b8e160f1-cf75-46ad-b7ca-f8054dadf11d tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b8e160f1-cf75-46ad-b7ca-f8054dadf11d tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b8e160f1-cf75-46ad-b7ca-f8054dadf11d tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b8e160f1-cf75-46ad-b7ca-f8054dadf11d tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:06 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-03ee805e-2975-4239-8859-b883d02863c6 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970941120>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:06 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-03ee805e-2975-4239-8859-b883d02863c6 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71" status: 200 len: 344 microversion: 2.1 time: 0.059091 Apr 14 15:44:06 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 145/438] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:44:06 2023] GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-plugged", "status": "completed", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}, {"server_uuid": "2d91a139-cb0c-40c1-99a1-6b34dcb60bed", "name": "network-vif-deleted", "tag": "cfb03b4e-c244-4ebd-bff5-7e250ac32044"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:44:07 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-b8e160f1-cf75-46ad-b7ca-f8054dadf11d tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855c585696694964974a8df948ab7899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac7fb012e144cdaa7da36ee9b590a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=19 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:44:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:07 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-b8e160f1-cf75-46ad-b7ca-f8054dadf11d tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60" status: 200 len: 1537 microversion: 2.1 time: 0.284704 Apr 14 15:44:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=31 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:44:07 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 148/439] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:44:06 2023] GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60 => generated 1537 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:44:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] Creating event network-vif-plugged:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:44:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] Creating event network-vif-deleted:cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed on user Apr 14 15:44:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033382 Apr 14 15:44:07 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 147/440] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:44:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:07 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c9942e6f-5184-4f7e-a685-eb8c31d61394 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970ccfac0>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:08 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-c9942e6f-5184-4f7e-a685-eb8c31d61394 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71" status: 200 len: 344 microversion: 2.1 time: 0.049484 Apr 14 15:44:08 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 146/441] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:44:07 2023] GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:44:08 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/action" status: 202 len: 0 microversion: 2.87 time: 0.084921 Apr 14 15:44:08 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 149/442] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 15:44:08 2023] POST /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:44:08 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-8898ce08-3e3a-4dd0-8e69-e1131f5c9184 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:08 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-8898ce08-3e3a-4dd0-8e69-e1131f5c9184 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8898ce08-3e3a-4dd0-8e69-e1131f5c9184 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8898ce08-3e3a-4dd0-8e69-e1131f5c9184 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8898ce08-3e3a-4dd0-8e69-e1131f5c9184 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8898ce08-3e3a-4dd0-8e69-e1131f5c9184 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8898ce08-3e3a-4dd0-8e69-e1131f5c9184 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8898ce08-3e3a-4dd0-8e69-e1131f5c9184 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-2bd18365-be77-41da-a883-09e2218fc7fb tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970943eb0>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-2bd18365-be77-41da-a883-09e2218fc7fb tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] HTTP exception thrown: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-2bd18365-be77-41da-a883-09e2218fc7fb tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Request method failure captured: Apr 14 15:44:09 user devstack@n-api.service[61875]: request: GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71 HTTP/1.1 Apr 14 15:44:09 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:44:09 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:44:09 user devstack@n-api.service[61875]: Connection: close Apr 14 15:44:09 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:44:09 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:44:09 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:44:09 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:44:09 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXS8fSLSKbVuOF6Z8J3lb_G24kMp0SuB7fbSoeP8xtbxVmVExjiyZ3IcW7VO0NaDhBF01jfiu5u4yVIxA2e2VN58vonBxlpNfNXt5gPJODs09odZ1oPEFxXgkFkmMQ9a7l4UIuXOTPthUBzYmP4tp-rqlUouKLPktWDSNpvZdzdW15o Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Project-Id: 1eface170b884bf1af960c428a15bab1 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1013928107 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1eface170b884bf1af960c428a15bab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1eface170b884bf1af960c428a15bab1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1eface170b884bf1af960c428a15bab1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1013928107 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Tenant-Id: 1eface170b884bf1af960c428a15bab1 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1013928107 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-User: tempest-VolumesSnapshotsTestJSON-1013928107-project-member Apr 14 15:44:09 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:44:09 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:44:09 user devstack@n-api.service[61875]: X-User-Id: 169aa1c0d37b4ab8a315bf55cfd9f535 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1013928107-project-member Apr 14 15:44:09 user devstack@n-api.service[61875]: method: Apr 14 15:44:09 user devstack@n-api.service[61875]: exception: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61875]: action_args: {'id': 'e61518af-544a-49c2-b0f4-a839e16c3b71'} Apr 14 15:44:09 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. (HTTP 404) (Request-ID: req-acad3568-fd82-4476-a28a-33cb55cde5a8) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-2bd18365-be77-41da-a883-09e2218fc7fb tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Returning 404 to user: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:44:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-2bd18365-be77-41da-a883-09e2218fc7fb tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71" status: 404 len: 109 microversion: 2.1 time: 0.043323 Apr 14 15:44:09 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 147/443] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:44:09 2023] GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:44:09 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-40e111da-288c-40fc-81e7-28ba0660e455 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970943d90>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:09 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-40e111da-288c-40fc-81e7-28ba0660e455 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] HTTP exception thrown: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-40e111da-288c-40fc-81e7-28ba0660e455 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Request method failure captured: Apr 14 15:44:09 user devstack@n-api.service[61876]: request: DELETE /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71 HTTP/1.1 Apr 14 15:44:09 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:44:09 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:44:09 user devstack@n-api.service[61876]: Connection: close Apr 14 15:44:09 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:44:09 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:44:09 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:44:09 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:44:09 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXS8fSLSKbVuOF6Z8J3lb_G24kMp0SuB7fbSoeP8xtbxVmVExjiyZ3IcW7VO0NaDhBF01jfiu5u4yVIxA2e2VN58vonBxlpNfNXt5gPJODs09odZ1oPEFxXgkFkmMQ9a7l4UIuXOTPthUBzYmP4tp-rqlUouKLPktWDSNpvZdzdW15o Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Project-Id: 1eface170b884bf1af960c428a15bab1 Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1013928107 Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1eface170b884bf1af960c428a15bab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1eface170b884bf1af960c428a15bab1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1eface170b884bf1af960c428a15bab1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1013928107 Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Tenant-Id: 1eface170b884bf1af960c428a15bab1 Apr 14 15:44:09 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1013928107 Apr 14 15:44:09 user devstack@n-api.service[61876]: X-User: tempest-VolumesSnapshotsTestJSON-1013928107-project-member Apr 14 15:44:09 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:44:09 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:44:09 user devstack@n-api.service[61876]: X-User-Id: 169aa1c0d37b4ab8a315bf55cfd9f535 Apr 14 15:44:09 user devstack@n-api.service[61876]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1013928107-project-member Apr 14 15:44:09 user devstack@n-api.service[61876]: method: Apr 14 15:44:09 user devstack@n-api.service[61876]: exception: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61876]: action_args: {'id': 'e61518af-544a-49c2-b0f4-a839e16c3b71'} Apr 14 15:44:09 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. (HTTP 404) (Request-ID: req-7058900a-c29f-4ab6-85c6-d32a1f17102a) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-40e111da-288c-40fc-81e7-28ba0660e455 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Returning 404 to user: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:44:09 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-40e111da-288c-40fc-81e7-28ba0660e455 tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71" status: 404 len: 109 microversion: 2.1 time: 0.043756 Apr 14 15:44:09 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 150/444] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 15:44:09 2023] DELETE /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:44:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-8926a258-14f6-430b-9cbf-5db164fb06ae tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Calling method '.version_select at 0x7f2970940e50>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:09 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-8898ce08-3e3a-4dd0-8e69-e1131f5c9184 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:09 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-8898ce08-3e3a-4dd0-8e69-e1131f5c9184 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:09 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-8898ce08-3e3a-4dd0-8e69-e1131f5c9184 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-8898ce08-3e3a-4dd0-8e69-e1131f5c9184 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" status: 200 len: 1762 microversion: 2.87 time: 0.279072 Apr 14 15:44:09 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 148/445] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:44:08 2023] GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => generated 1762 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:44:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-8926a258-14f6-430b-9cbf-5db164fb06ae tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] HTTP exception thrown: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-8926a258-14f6-430b-9cbf-5db164fb06ae tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Request method failure captured: Apr 14 15:44:09 user devstack@n-api.service[61875]: request: GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71 HTTP/1.1 Apr 14 15:44:09 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:44:09 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:44:09 user devstack@n-api.service[61875]: Connection: close Apr 14 15:44:09 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:44:09 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:44:09 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:44:09 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:44:09 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXS8fSLSKbVuOF6Z8J3lb_G24kMp0SuB7fbSoeP8xtbxVmVExjiyZ3IcW7VO0NaDhBF01jfiu5u4yVIxA2e2VN58vonBxlpNfNXt5gPJODs09odZ1oPEFxXgkFkmMQ9a7l4UIuXOTPthUBzYmP4tp-rqlUouKLPktWDSNpvZdzdW15o Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Project-Id: 1eface170b884bf1af960c428a15bab1 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1013928107 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1eface170b884bf1af960c428a15bab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1eface170b884bf1af960c428a15bab1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1eface170b884bf1af960c428a15bab1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1013928107 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Tenant-Id: 1eface170b884bf1af960c428a15bab1 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1013928107 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-User: tempest-VolumesSnapshotsTestJSON-1013928107-project-member Apr 14 15:44:09 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:44:09 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:44:09 user devstack@n-api.service[61875]: X-User-Id: 169aa1c0d37b4ab8a315bf55cfd9f535 Apr 14 15:44:09 user devstack@n-api.service[61875]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1013928107-project-member Apr 14 15:44:09 user devstack@n-api.service[61875]: method: Apr 14 15:44:09 user devstack@n-api.service[61875]: exception: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61875]: action_args: {'id': 'e61518af-544a-49c2-b0f4-a839e16c3b71'} Apr 14 15:44:09 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. (HTTP 404) (Request-ID: req-83c78c34-3e86-4264-bf1f-0845f3e53099) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. Apr 14 15:44:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-8926a258-14f6-430b-9cbf-5db164fb06ae tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] Returning 404 to user: Volume e61518af-544a-49c2-b0f4-a839e16c3b71 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:44:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-8926a258-14f6-430b-9cbf-5db164fb06ae tempest-VolumesSnapshotsTestJSON-1013928107 tempest-VolumesSnapshotsTestJSON-1013928107-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71" status: 404 len: 109 microversion: 2.1 time: 0.041275 Apr 14 15:44:09 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 148/446] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:44:09 2023] GET /compute/v2.1/os-volumes/e61518af-544a-49c2-b0f4-a839e16c3b71 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:44:09 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-da5173bd-af7f-41e9-b0dc-7516717590bd req-b3ecfd24-7810-4e57-bd60-7ee0eb78a5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-unplugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:44:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-da5173bd-af7f-41e9-b0dc-7516717590bd req-b3ecfd24-7810-4e57-bd60-7ee0eb78a5b7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-da5173bd-af7f-41e9-b0dc-7516717590bd req-b3ecfd24-7810-4e57-bd60-7ee0eb78a5b7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-da5173bd-af7f-41e9-b0dc-7516717590bd req-b3ecfd24-7810-4e57-bd60-7ee0eb78a5b7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:09 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-da5173bd-af7f-41e9-b0dc-7516717590bd req-b3ecfd24-7810-4e57-bd60-7ee0eb78a5b7 service nova] Creating event network-vif-unplugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:44:09 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-da5173bd-af7f-41e9-b0dc-7516717590bd req-b3ecfd24-7810-4e57-bd60-7ee0eb78a5b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037711 Apr 14 15:44:09 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 151/447] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:44:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:11 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-plugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}, {"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-plugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}, {"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-plugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}, {"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-unplugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}, {"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-plugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}, {"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-plugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:44:11 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:11 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:11 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:11 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Creating event network-vif-plugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:44:11 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Creating event network-vif-plugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:44:11 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Creating event network-vif-plugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:44:11 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Creating event network-vif-unplugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:44:11 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Creating event network-vif-plugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:44:11 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Creating event network-vif-plugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:44:11 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.066384 Apr 14 15:44:11 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 149/448] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:44:11 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:44:12 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=14 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:44:12 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:44:12 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6241d23e-77cc-4ab9-9416-d546c7b9829b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1423833907", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "destination_type": "local"}, {"source_type": "volume", "uuid": "b628aeca-5982-4eff-96db-1347540632d7", "destination_type": "invalid"}], "networks": [{"uuid": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40"}]}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:44:12 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6241d23e-77cc-4ab9-9416-d546c7b9829b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Request method failure captured: Apr 14 15:44:12 user devstack@n-api.service[61875]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 15:44:12 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:44:12 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:44:12 user devstack@n-api.service[61875]: Connection: close Apr 14 15:44:12 user devstack@n-api.service[61875]: Content-Length: 494 Apr 14 15:44:12 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:44:12 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:44:12 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:44:12 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXL95JWLmONfTrhpJmmUWoidh6SxM6nOj4T6nb8eiCzGyQ8xri5QYFuYNhdtZLUHL4oGnJqSuEepZDj66OEbgJzZJeiNKYrkGdM78HBIq2CBd_mG7YSrfK2eef4zoe0o--DIA0Ny5tXerL6dbd4mO3kxcJGCA4XuQGooGSa-qHGlW8A Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Project-Id: 3a8e73ef2ad94e84876def53ddf43da4 Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Project-Name: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Tenant: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Tenant-Id: 3a8e73ef2ad94e84876def53ddf43da4 Apr 14 15:44:12 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:44:12 user devstack@n-api.service[61875]: X-User: tempest-ServersNegativeTestJSON-443911091-project-member Apr 14 15:44:12 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:44:12 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:44:12 user devstack@n-api.service[61875]: X-User-Id: af824b840c604223afd90bce17fe1ceb Apr 14 15:44:12 user devstack@n-api.service[61875]: X-User-Name: tempest-ServersNegativeTestJSON-443911091-project-member Apr 14 15:44:12 user devstack@n-api.service[61875]: Apr 14 15:44:12 user devstack@n-api.service[61875]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1423833907", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "destination_type": "local"}, {"source_type": "volume", "uuid": "b628aeca-5982-4eff-96db-1347540632d7", "destination_type": "invalid"}], "networks": [{"uuid": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40"}]}} Apr 14 15:44:12 user devstack@n-api.service[61875]: method: > Apr 14 15:44:12 user devstack@n-api.service[61875]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 15:44:12 user devstack@n-api.service[61875]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1423833907', 'imageRef': 'e3a0daa8-78ae-44af-8756-1fad21c352f3', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'e3a0daa8-78ae-44af-8756-1fad21c352f3', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'b628aeca-5982-4eff-96db-1347540632d7', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'dd14d44b-4a04-4aa4-9dfd-1933f29c3a40'}]}}} Apr 14 15:44:12 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise error Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi 'invalid' Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 15:44:12 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:12 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6241d23e-77cc-4ab9-9416-d546c7b9829b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:44:12 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-6241d23e-77cc-4ab9-9416-d546c7b9829b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.020257 Apr 14 15:44:12 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 149/449] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:44:12 2023] POST /compute/v2.1/servers => generated 155 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:44:12 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-f924bcc7-8547-423e-89fe-54d6c8ca9b42 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:12 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-f924bcc7-8547-423e-89fe-54d6c8ca9b42 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:12 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f924bcc7-8547-423e-89fe-54d6c8ca9b42 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:12 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f924bcc7-8547-423e-89fe-54d6c8ca9b42 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:12 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f924bcc7-8547-423e-89fe-54d6c8ca9b42 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:12 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f924bcc7-8547-423e-89fe-54d6c8ca9b42 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:12 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f924bcc7-8547-423e-89fe-54d6c8ca9b42 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:12 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f924bcc7-8547-423e-89fe-54d6c8ca9b42 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:13 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-f924bcc7-8547-423e-89fe-54d6c8ca9b42 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af824b840c604223afd90bce17fe1ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e73ef2ad94e84876def53ddf43da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:13 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-f924bcc7-8547-423e-89fe-54d6c8ca9b42 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a" status: 200 len: 1494 microversion: 2.1 time: 0.241776 Apr 14 15:44:13 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 152/450] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:44:12 2023] GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a => generated 1494 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:44:13 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-62bbd44f-c464-4b99-8ce9-a093efb5c25b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:13 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-62bbd44f-c464-4b99-8ce9-a093efb5c25b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-62bbd44f-c464-4b99-8ce9-a093efb5c25b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-62bbd44f-c464-4b99-8ce9-a093efb5c25b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-62bbd44f-c464-4b99-8ce9-a093efb5c25b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-62bbd44f-c464-4b99-8ce9-a093efb5c25b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-62bbd44f-c464-4b99-8ce9-a093efb5c25b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-62bbd44f-c464-4b99-8ce9-a093efb5c25b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:13 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-62bbd44f-c464-4b99-8ce9-a093efb5c25b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:13 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-62bbd44f-c464-4b99-8ce9-a093efb5c25b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4" status: 200 len: 1502 microversion: 2.1 time: 0.240824 Apr 14 15:44:13 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 150/451] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:44:13 2023] GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4 => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:44:14 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-8a549cd3-0636-4704-911b-fe6dc69bae5a req-a5578bed-942d-419e-a892-cbc39147af8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-plugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:44:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-8a549cd3-0636-4704-911b-fe6dc69bae5a req-a5578bed-942d-419e-a892-cbc39147af8d service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-8a549cd3-0636-4704-911b-fe6dc69bae5a req-a5578bed-942d-419e-a892-cbc39147af8d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-8a549cd3-0636-4704-911b-fe6dc69bae5a req-a5578bed-942d-419e-a892-cbc39147af8d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:14 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-8a549cd3-0636-4704-911b-fe6dc69bae5a req-a5578bed-942d-419e-a892-cbc39147af8d service nova] Creating event network-vif-plugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:44:14 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-8a549cd3-0636-4704-911b-fe6dc69bae5a req-a5578bed-942d-419e-a892-cbc39147af8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035554 Apr 14 15:44:14 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 150/452] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:44:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:34 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:44:34 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:44:34 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-b8f01b09-9869-4b94-abda-59d867656671 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:34 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-b8f01b09-9869-4b94-abda-59d867656671 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b8f01b09-9869-4b94-abda-59d867656671 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b8f01b09-9869-4b94-abda-59d867656671 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b8f01b09-9869-4b94-abda-59d867656671 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b8f01b09-9869-4b94-abda-59d867656671 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b8f01b09-9869-4b94-abda-59d867656671 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b8f01b09-9869-4b94-abda-59d867656671 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:34 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-b8f01b09-9869-4b94-abda-59d867656671 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-b8f01b09-9869-4b94-abda-59d867656671 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36" status: 200 len: 1749 microversion: 2.1 time: 0.334729 Apr 14 15:44:34 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 153/453] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:44:34 2023] GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36 => generated 1749 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:44:39 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4bab3fd4-bb9e-4850-b88a-52e5ae07afd5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:39 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-4bab3fd4-bb9e-4850-b88a-52e5ae07afd5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:39 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=9 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:44:39 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=15 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:44:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4bab3fd4-bb9e-4850-b88a-52e5ae07afd5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4bab3fd4-bb9e-4850-b88a-52e5ae07afd5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4bab3fd4-bb9e-4850-b88a-52e5ae07afd5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4bab3fd4-bb9e-4850-b88a-52e5ae07afd5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4bab3fd4-bb9e-4850-b88a-52e5ae07afd5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4bab3fd4-bb9e-4850-b88a-52e5ae07afd5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:39 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-4bab3fd4-bb9e-4850-b88a-52e5ae07afd5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:39 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-4bab3fd4-bb9e-4850-b88a-52e5ae07afd5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1657 microversion: 2.1 time: 0.287086 Apr 14 15:44:39 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 151/454] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:44:39 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1657 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:44:39 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:44:39 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:44:39 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b38580d-ee34-4663-a8dd-8f2e35ffc774"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:44:39 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353343 Apr 14 15:44:40 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 151/455] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:44:39 2023] POST /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:47 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-14bbb926-db27-485c-a58a-e5b29fcc276c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:47 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-14bbb926-db27-485c-a58a-e5b29fcc276c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:47 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:44:47 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:44:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-14bbb926-db27-485c-a58a-e5b29fcc276c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-14bbb926-db27-485c-a58a-e5b29fcc276c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-14bbb926-db27-485c-a58a-e5b29fcc276c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-14bbb926-db27-485c-a58a-e5b29fcc276c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-14bbb926-db27-485c-a58a-e5b29fcc276c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-14bbb926-db27-485c-a58a-e5b29fcc276c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:47 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-14bbb926-db27-485c-a58a-e5b29fcc276c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:47 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-14bbb926-db27-485c-a58a-e5b29fcc276c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1703 microversion: 2.1 time: 0.212676 Apr 14 15:44:47 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 154/456] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:44:47 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1703 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1544279830", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for project 95e26fa4727e46479d108fe49e225706. Resources: dict_keys(['metadata_items']) {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for user 3062186c340a4cfe875d5455b0ace246 and project 95e26fa4727e46479d108fe49e225706. Resources: dict_keys(['metadata_items']) {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:48 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:48 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/action" status: 202 len: 1159 microversion: 2.1 time: 0.350295 Apr 14 15:44:48 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 152/457] 10.0.0.210 () {64 vars in 1356 bytes} [Fri Apr 14 15:44:47 2023] POST /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/action => generated 1159 bytes in 352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 15:44:48 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-4bdd09b9-8b12-4283-8e06-fa7b3cc79e4f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:48 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-4bdd09b9-8b12-4283-8e06-fa7b3cc79e4f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:48 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bdd09b9-8b12-4283-8e06-fa7b3cc79e4f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:48 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bdd09b9-8b12-4283-8e06-fa7b3cc79e4f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:48 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bdd09b9-8b12-4283-8e06-fa7b3cc79e4f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:48 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bdd09b9-8b12-4283-8e06-fa7b3cc79e4f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:48 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bdd09b9-8b12-4283-8e06-fa7b3cc79e4f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:48 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4bdd09b9-8b12-4283-8e06-fa7b3cc79e4f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:48 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-4bdd09b9-8b12-4283-8e06-fa7b3cc79e4f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:48 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-4bdd09b9-8b12-4283-8e06-fa7b3cc79e4f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1731 microversion: 2.1 time: 0.162189 Apr 14 15:44:48 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 152/458] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:44:48 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:44:48 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-17cd7d84-0579-479f-ac21-b8f9b6ba782d req-c3c8645a-14c3-4cc5-84de-c403b416d826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-unplugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:44:48 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-17cd7d84-0579-479f-ac21-b8f9b6ba782d req-c3c8645a-14c3-4cc5-84de-c403b416d826 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:48 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-17cd7d84-0579-479f-ac21-b8f9b6ba782d req-c3c8645a-14c3-4cc5-84de-c403b416d826 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:48 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-17cd7d84-0579-479f-ac21-b8f9b6ba782d req-c3c8645a-14c3-4cc5-84de-c403b416d826 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:48 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-17cd7d84-0579-479f-ac21-b8f9b6ba782d req-c3c8645a-14c3-4cc5-84de-c403b416d826 service nova] Creating event network-vif-unplugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:44:48 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-17cd7d84-0579-479f-ac21-b8f9b6ba782d req-c3c8645a-14c3-4cc5-84de-c403b416d826 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035937 Apr 14 15:44:48 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 155/459] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:44:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:50 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-873fa695-6fc5-4919-bb6a-c0c80a7f7a9a req-1305bdc9-76fe-49fe-8671-eff13c84fd42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-plugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:44:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-873fa695-6fc5-4919-bb6a-c0c80a7f7a9a req-1305bdc9-76fe-49fe-8671-eff13c84fd42 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-873fa695-6fc5-4919-bb6a-c0c80a7f7a9a req-1305bdc9-76fe-49fe-8671-eff13c84fd42 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-873fa695-6fc5-4919-bb6a-c0c80a7f7a9a req-1305bdc9-76fe-49fe-8671-eff13c84fd42 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:50 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-873fa695-6fc5-4919-bb6a-c0c80a7f7a9a req-1305bdc9-76fe-49fe-8671-eff13c84fd42 service nova] Creating event network-vif-plugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:44:51 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-873fa695-6fc5-4919-bb6a-c0c80a7f7a9a req-1305bdc9-76fe-49fe-8671-eff13c84fd42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028794 Apr 14 15:44:51 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 153/460] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:44:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:44:52 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-1138b4e3-ab92-4b9f-9079-e0ee9f376157 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:52 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-1138b4e3-ab92-4b9f-9079-e0ee9f376157 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1138b4e3-ab92-4b9f-9079-e0ee9f376157 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1138b4e3-ab92-4b9f-9079-e0ee9f376157 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1138b4e3-ab92-4b9f-9079-e0ee9f376157 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1138b4e3-ab92-4b9f-9079-e0ee9f376157 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1138b4e3-ab92-4b9f-9079-e0ee9f376157 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1138b4e3-ab92-4b9f-9079-e0ee9f376157 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-1138b4e3-ab92-4b9f-9079-e0ee9f376157 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] HTTP exception thrown: Instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed could not be found. Apr 14 15:44:52 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-1138b4e3-ab92-4b9f-9079-e0ee9f376157 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Request method failure captured: Apr 14 15:44:52 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed HTTP/1.1 Apr 14 15:44:52 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:44:52 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:44:52 user devstack@n-api.service[61875]: Connection: close Apr 14 15:44:52 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:44:52 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:44:52 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:44:52 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:44:52 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXMB_J0rbLQUBzQ86uG6p2wHxK-3GqeKyURqEHtMFOJvtAM76mEv4I4jrsh6EHnH7QDaTpgU4k4NeCKi0CwSKXumKI4Eu5HKOYSBLjWJQNzL_jubTQIamRpDz5s2c1jCD6IyZX7k37-NaymUpQ559WImk5ZkP-0vUSJeURKWFLH2Es0 Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Project-Id: a8230c5386464f288fd783b3c60536b4 Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Project-Name: tempest-ServerStableDeviceRescueTest-2130046820 Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a8230c5386464f288fd783b3c60536b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8230c5386464f288fd783b3c60536b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8230c5386464f288fd783b3c60536b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Tenant: tempest-ServerStableDeviceRescueTest-2130046820 Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Tenant-Id: a8230c5386464f288fd783b3c60536b4 Apr 14 15:44:52 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-2130046820 Apr 14 15:44:52 user devstack@n-api.service[61875]: X-User: tempest-ServerStableDeviceRescueTest-2130046820-project-member Apr 14 15:44:52 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:44:52 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:44:52 user devstack@n-api.service[61875]: X-User-Id: f805db20d87d4429981c975ebd88ed92 Apr 14 15:44:52 user devstack@n-api.service[61875]: X-User-Name: tempest-ServerStableDeviceRescueTest-2130046820-project-member Apr 14 15:44:52 user devstack@n-api.service[61875]: method: > Apr 14 15:44:52 user devstack@n-api.service[61875]: exception: Instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed could not be found. Apr 14 15:44:52 user devstack@n-api.service[61875]: action_args: {'id': '2d91a139-cb0c-40c1-99a1-6b34dcb60bed'} Apr 14 15:44:52 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed could not be found. Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed could not be found. Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed could not be found. Apr 14 15:44:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:44:52 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-1138b4e3-ab92-4b9f-9079-e0ee9f376157 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Returning 404 to user: Instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:44:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-1138b4e3-ab92-4b9f-9079-e0ee9f376157 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed" status: 404 len: 111 microversion: 2.1 time: 0.028474 Apr 14 15:44:52 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 153/461] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:44:52 2023] GET /compute/v2.1/servers/2d91a139-cb0c-40c1-99a1-6b34dcb60bed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:44:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-1a31ded7-0831-4ee6-8dc6-62b98fd90588 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Calling method '.version_select at 0x7f29709cc0d0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:53 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-1a31ded7-0831-4ee6-8dc6-62b98fd90588 tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-985297908" status: 202 len: 0 microversion: 2.1 time: 0.140179 Apr 14 15:44:53 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 156/462] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 15:44:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-985297908 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:44:57 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-56b53321-280a-43cb-8920-5ab274cd8d89 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:57 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-56b53321-280a-43cb-8920-5ab274cd8d89 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-56b53321-280a-43cb-8920-5ab274cd8d89 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-56b53321-280a-43cb-8920-5ab274cd8d89 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-56b53321-280a-43cb-8920-5ab274cd8d89 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-56b53321-280a-43cb-8920-5ab274cd8d89 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-56b53321-280a-43cb-8920-5ab274cd8d89 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-56b53321-280a-43cb-8920-5ab274cd8d89 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:58 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-56b53321-280a-43cb-8920-5ab274cd8d89 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee063f686de4a9f9e6b5fe1e7ce2c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737ea257ab5448389bd751841be0fc72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-56b53321-280a-43cb-8920-5ab274cd8d89 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48" status: 200 len: 1569 microversion: 2.1 time: 0.227177 Apr 14 15:44:58 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 154/463] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:44:57 2023] GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48 => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:44:59 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-5d19eeae-f08a-410a-b392-f0854bcb8cee tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:44:59 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-5d19eeae-f08a-410a-b392-f0854bcb8cee tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:44:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5d19eeae-f08a-410a-b392-f0854bcb8cee tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5d19eeae-f08a-410a-b392-f0854bcb8cee tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5d19eeae-f08a-410a-b392-f0854bcb8cee tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5d19eeae-f08a-410a-b392-f0854bcb8cee tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:44:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5d19eeae-f08a-410a-b392-f0854bcb8cee tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:44:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5d19eeae-f08a-410a-b392-f0854bcb8cee tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:44:59 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-5d19eeae-f08a-410a-b392-f0854bcb8cee tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:59 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-5d19eeae-f08a-410a-b392-f0854bcb8cee tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:59 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-5d19eeae-f08a-410a-b392-f0854bcb8cee tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:44:59 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-5d19eeae-f08a-410a-b392-f0854bcb8cee tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" status: 200 len: 1768 microversion: 2.87 time: 0.244169 Apr 14 15:44:59 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 154/464] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:44:59 2023] GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => generated 1768 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:45:00 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-05e3f46a-722a-4eab-acc3-3980c06d513d req-bf0ebc0a-89da-4b34-b360-ed133fbafd1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-plugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:00 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:00 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-05e3f46a-722a-4eab-acc3-3980c06d513d req-bf0ebc0a-89da-4b34-b360-ed133fbafd1f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:00 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-05e3f46a-722a-4eab-acc3-3980c06d513d req-bf0ebc0a-89da-4b34-b360-ed133fbafd1f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:00 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-05e3f46a-722a-4eab-acc3-3980c06d513d req-bf0ebc0a-89da-4b34-b360-ed133fbafd1f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:00 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-05e3f46a-722a-4eab-acc3-3980c06d513d req-bf0ebc0a-89da-4b34-b360-ed133fbafd1f service nova] Creating event network-vif-plugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:45:00 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-05e3f46a-722a-4eab-acc3-3980c06d513d req-bf0ebc0a-89da-4b34-b360-ed133fbafd1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038162 Apr 14 15:45:00 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 157/465] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:45:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:45:01 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-e1b9b527-a169-4337-b504-1f8c7897fa87 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] Calling method '.version_select at 0x7f2970bdb640>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:01 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-e1b9b527-a169-4337-b504-1f8c7897fa87 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c07f7211-5475-457d-8e76-c1a1544296ee" status: 200 len: 351 microversion: 2.1 time: 0.049675 Apr 14 15:45:01 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 155/466] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:45:01 2023] GET /compute/v2.1/os-volumes/c07f7211-5475-457d-8e76-c1a1544296ee => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:02 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-07d8ad2a-a348-4bf8-a712-41b6dd9104e8 req-22756158-abd5-46c0-ac7f-9cfa948c7bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-plugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-07d8ad2a-a348-4bf8-a712-41b6dd9104e8 req-22756158-abd5-46c0-ac7f-9cfa948c7bdd service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-07d8ad2a-a348-4bf8-a712-41b6dd9104e8 req-22756158-abd5-46c0-ac7f-9cfa948c7bdd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-07d8ad2a-a348-4bf8-a712-41b6dd9104e8 req-22756158-abd5-46c0-ac7f-9cfa948c7bdd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-07d8ad2a-a348-4bf8-a712-41b6dd9104e8 req-22756158-abd5-46c0-ac7f-9cfa948c7bdd service nova] Creating event network-vif-plugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:45:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-07d8ad2a-a348-4bf8-a712-41b6dd9104e8 req-22756158-abd5-46c0-ac7f-9cfa948c7bdd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031484 Apr 14 15:45:02 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 155/467] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:45:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:02 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc81318c-1157-4832-919a-28cc14431f48", "tag": "3f7d69ad-aaff-498b-8862-241238c91a38"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:02 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] Creating event network-changed:3f7d69ad-aaff-498b-8862-241238c91a38 for instance cc81318c-1157-4832-919a-28cc14431f48 on user Apr 14 15:45:02 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046599 Apr 14 15:45:02 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 158/468] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:45:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:03 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-9a00828b-3d9c-4b44-9ad7-5a884aeefd73 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] Calling method '.version_select at 0x7f297094e4d0>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:03 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-9a00828b-3d9c-4b44-9ad7-5a884aeefd73 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/2b78824a-ec01-48a4-9c0b-348e24e77fd5" status: 200 len: 351 microversion: 2.1 time: 0.086086 Apr 14 15:45:03 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 156/469] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:45:03 2023] GET /compute/v2.1/os-volumes/2b78824a-ec01-48a4-9c0b-348e24e77fd5 => generated 351 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:45:04 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "597dad96-7242-4822-9c01-a5d1681ce980"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:04 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320303 Apr 14 15:45:04 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 156/470] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:45:04 2023] POST /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:06 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5d10b589-da84-4ac9-826a-355874edc157 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] Calling method '.version_select at 0x7f29709ced40>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:06 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5d10b589-da84-4ac9-826a-355874edc157 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f904d717-c88a-4d2d-8d2d-5cca50374c3d" status: 200 len: 351 microversion: 2.1 time: 0.062157 Apr 14 15:45:06 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 159/471] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 15:45:06 2023] GET /compute/v2.1/os-volumes/f904d717-c88a-4d2d-8d2d-5cca50374c3d => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:06 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3ac7bdb6-30a8-4dab-9e07-59e8b4316bc8 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] Calling method '.version_select at 0x7f2970cc1480>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:06 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-3ac7bdb6-30a8-4dab-9e07-59e8b4316bc8 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.101086 Apr 14 15:45:06 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 157/472] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 15:45:06 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:45:06 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-dbcfa2a5-57eb-4cc0-979a-8f39a06d638d tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] Calling method '.version_select at 0x7f2970a8b490>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:06 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-dbcfa2a5-57eb-4cc0-979a-8f39a06d638d tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.119545 Apr 14 15:45:06 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 157/473] 10.0.0.210 () {62 vars in 1226 bytes} [Fri Apr 14 15:45:06 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:45:06 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-3139ada1-7bb4-4149-b17b-4ba895cb4f38 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] Calling method '.version_select at 0x7f29709ce0e0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:06 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-3139ada1-7bb4-4149-b17b-4ba895cb4f38 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085630 Apr 14 15:45:06 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 160/474] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 15:45:06 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:45:06 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-46f7ff39-ab0c-4caa-ba82-ff9d9a070788 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] Calling method '.version_select at 0x7f297094d360>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:06 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-46f7ff39-ab0c-4caa-ba82-ff9d9a070788 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.115637 Apr 14 15:45:06 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 158/475] 10.0.0.210 () {62 vars in 1244 bytes} [Fri Apr 14 15:45:06 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:06 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-0bf074a8-7373-428c-a606-74808fe54061 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] Calling method '.version_select at 0x7f2970943370>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:07 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-0bf074a8-7373-428c-a606-74808fe54061 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085159 Apr 14 15:45:07 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 158/476] 10.0.0.210 () {62 vars in 1247 bytes} [Fri Apr 14 15:45:06 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:07 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-9ad312a7-b4bc-41bc-8148-1663c1c63d27 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] Calling method '.version_select at 0x7f2970bb53f0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-898971f4-e786-41e2-9e11-208f6c5c8223 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:07 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-898971f4-e786-41e2-9e11-208f6c5c8223 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:07 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-9ad312a7-b4bc-41bc-8148-1663c1c63d27 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.082097 Apr 14 15:45:07 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 161/477] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 15:45:07 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:45:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-898971f4-e786-41e2-9e11-208f6c5c8223 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-898971f4-e786-41e2-9e11-208f6c5c8223 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-898971f4-e786-41e2-9e11-208f6c5c8223 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-898971f4-e786-41e2-9e11-208f6c5c8223 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-898971f4-e786-41e2-9e11-208f6c5c8223 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-898971f4-e786-41e2-9e11-208f6c5c8223 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:07 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-73e84b70-8f4a-4add-bd65-2a0c10af4aba tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] Calling method '.version_select at 0x7f2970a8acb0>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:07 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-898971f4-e786-41e2-9e11-208f6c5c8223 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855c585696694964974a8df948ab7899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac7fb012e144cdaa7da36ee9b590a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:45:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-898971f4-e786-41e2-9e11-208f6c5c8223 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60" status: 200 len: 1537 microversion: 2.1 time: 0.265171 Apr 14 15:45:07 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 159/478] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:45:07 2023] GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60 => generated 1537 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:45:07 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-73e84b70-8f4a-4add-bd65-2a0c10af4aba tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.471132 Apr 14 15:45:07 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 159/479] 10.0.0.210 () {62 vars in 1265 bytes} [Fri Apr 14 15:45:07 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:07 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5447a043-4530-4571-886b-81388ac8b160 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] Calling method '.version_select at 0x7f29709cfb50>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:07 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5447a043-4530-4571-886b-81388ac8b160 tempest-VolumesTestJSON-129749881 tempest-VolumesTestJSON-129749881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.101345 Apr 14 15:45:07 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 162/480] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 15:45:07 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:45:09 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203e4039-aa71-4521-8e74-02452436cb60", "tag": "59970400-49c0-4153-85a7-7b9b9496df26"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] Creating event network-changed:59970400-49c0-4153-85a7-7b9b9496df26 for instance 203e4039-aa71-4521-8e74-02452436cb60 on user Apr 14 15:45:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033740 Apr 14 15:45:09 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 160/481] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:45:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0991f31-aa0c-498b-934c-109652675c69"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:09 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "POST /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330107 Apr 14 15:45:09 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 160/482] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:45:09 2023] POST /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-477634aa-dbf8-43c9-9cd4-af0705977e0f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Action: 'create', calling method: .version_select at 0x7f29709cd630>, body: {"keypair": {"name": "tempest-keypair-2069158824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpwpHpSgjKFFOfT3sSZFGtHW7aHEqY3D7iHTUwEt+HEW6CaFV/NwHuNuh6qVxkjw80tHEBbK1oT4PIGP9fCBT1gDmfTs67kVNJUEGodNvnDGO8uYB8ceVoLe2Fz/R9eFA=="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:16 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-477634aa-dbf8-43c9-9cd4-af0705977e0f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting quotas for project 609ac7b149e14baab270d83a2646fbdf. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:45:16 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-477634aa-dbf8-43c9-9cd4-af0705977e0f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting quotas for user 3fa924fefda1428d81152fd573540f26 and project 609ac7b149e14baab270d83a2646fbdf. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:45:16 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-477634aa-dbf8-43c9-9cd4-af0705977e0f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061886 Apr 14 15:45:16 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 163/483] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 15:45:16 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:18 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-105829218", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd"}], "security_groups": [{"name": "tempest-securitygroup--1409889554"}], "key_name": "tempest-keypair-2069158824", "user_data": "}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:18 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=25 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:18 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] validate_networks() for [('1db86179-bd15-40ef-af2b-5d1b5c8fb4bd', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting quotas for project 609ac7b149e14baab270d83a2646fbdf. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting quotas for user 3fa924fefda1428d81152fd573540f26 and project 609ac7b149e14baab270d83a2646fbdf. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:45:19 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:45:19 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.870154 Apr 14 15:45:19 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 161/484] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:45:18 2023] POST /compute/v2.1/servers => generated 407 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:45:19 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-400da9b0-a32d-440a-9998-7edf95302b8e tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:19 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-400da9b0-a32d-440a-9998-7edf95302b8e tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:19 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=17 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:19 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-400da9b0-a32d-440a-9998-7edf95302b8e tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:45:19 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-400da9b0-a32d-440a-9998-7edf95302b8e tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" status: 200 len: 1239 microversion: 2.1 time: 0.092422 Apr 14 15:45:19 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 161/485] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:45:19 2023] GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => generated 1239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:45:20 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-48264774-cfb6-4a88-b53e-cff339170ff2 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:20 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-48264774-cfb6-4a88-b53e-cff339170ff2 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-48264774-cfb6-4a88-b53e-cff339170ff2 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-48264774-cfb6-4a88-b53e-cff339170ff2 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-48264774-cfb6-4a88-b53e-cff339170ff2 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-48264774-cfb6-4a88-b53e-cff339170ff2 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-48264774-cfb6-4a88-b53e-cff339170ff2 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-48264774-cfb6-4a88-b53e-cff339170ff2 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-48264774-cfb6-4a88-b53e-cff339170ff2 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] HTTP exception thrown: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-48264774-cfb6-4a88-b53e-cff339170ff2 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Request method failure captured: Apr 14 15:45:21 user devstack@n-api.service[61876]: request: DELETE /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 HTTP/1.1 Apr 14 15:45:21 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:45:21 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:45:21 user devstack@n-api.service[61876]: Connection: close Apr 14 15:45:21 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:45:21 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:45:21 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:45:21 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:45:21 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXL95JWLmONfTrhpJmmUWoidh6SxM6nOj4T6nb8eiCzGyQ8xri5QYFuYNhdtZLUHL4oGnJqSuEepZDj66OEbgJzZJeiNKYrkGdM78HBIq2CBd_mG7YSrfK2eef4zoe0o--DIA0Ny5tXerL6dbd4mO3kxcJGCA4XuQGooGSa-qHGlW8A Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Project-Id: 3a8e73ef2ad94e84876def53ddf43da4 Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Project-Name: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Tenant: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Tenant-Id: 3a8e73ef2ad94e84876def53ddf43da4 Apr 14 15:45:21 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:45:21 user devstack@n-api.service[61876]: X-User: tempest-ServersNegativeTestJSON-443911091-project-member Apr 14 15:45:21 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:45:21 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:45:21 user devstack@n-api.service[61876]: X-User-Id: af824b840c604223afd90bce17fe1ceb Apr 14 15:45:21 user devstack@n-api.service[61876]: X-User-Name: tempest-ServersNegativeTestJSON-443911091-project-member Apr 14 15:45:21 user devstack@n-api.service[61876]: method: > Apr 14 15:45:21 user devstack@n-api.service[61876]: exception: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:45:21 user devstack@n-api.service[61876]: action_args: {'id': 'f5f1e2d0-08c5-4f11-b90a-7257a14e4e62'} Apr 14 15:45:21 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:45:21 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-48264774-cfb6-4a88-b53e-cff339170ff2 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Returning 404 to user: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:45:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-48264774-cfb6-4a88-b53e-cff339170ff2 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" status: 404 len: 111 microversion: 2.1 time: 0.041603 Apr 14 15:45:21 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 164/486] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:45:20 2023] DELETE /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-8bb68223-3f19-4316-ba81-d2a8b3b00c69 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-8bb68223-3f19-4316-ba81-d2a8b3b00c69 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8bb68223-3f19-4316-ba81-d2a8b3b00c69 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8bb68223-3f19-4316-ba81-d2a8b3b00c69 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8bb68223-3f19-4316-ba81-d2a8b3b00c69 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8bb68223-3f19-4316-ba81-d2a8b3b00c69 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8bb68223-3f19-4316-ba81-d2a8b3b00c69 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8bb68223-3f19-4316-ba81-d2a8b3b00c69 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:21 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-8bb68223-3f19-4316-ba81-d2a8b3b00c69 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] HTTP exception thrown: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-8bb68223-3f19-4316-ba81-d2a8b3b00c69 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Request method failure captured: Apr 14 15:45:21 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 HTTP/1.1 Apr 14 15:45:21 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:45:21 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:45:21 user devstack@n-api.service[61874]: Connection: close Apr 14 15:45:21 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:45:21 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:45:21 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:45:21 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:45:21 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXL95JWLmONfTrhpJmmUWoidh6SxM6nOj4T6nb8eiCzGyQ8xri5QYFuYNhdtZLUHL4oGnJqSuEepZDj66OEbgJzZJeiNKYrkGdM78HBIq2CBd_mG7YSrfK2eef4zoe0o--DIA0Ny5tXerL6dbd4mO3kxcJGCA4XuQGooGSa-qHGlW8A Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Project-Id: 3a8e73ef2ad94e84876def53ddf43da4 Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Project-Name: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Tenant: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Tenant-Id: 3a8e73ef2ad94e84876def53ddf43da4 Apr 14 15:45:21 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:45:21 user devstack@n-api.service[61874]: X-User: tempest-ServersNegativeTestJSON-443911091-project-member Apr 14 15:45:21 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:45:21 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:45:21 user devstack@n-api.service[61874]: X-User-Id: af824b840c604223afd90bce17fe1ceb Apr 14 15:45:21 user devstack@n-api.service[61874]: X-User-Name: tempest-ServersNegativeTestJSON-443911091-project-member Apr 14 15:45:21 user devstack@n-api.service[61874]: method: > Apr 14 15:45:21 user devstack@n-api.service[61874]: exception: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:45:21 user devstack@n-api.service[61874]: action_args: {'id': 'f5f1e2d0-08c5-4f11-b90a-7257a14e4e62'} Apr 14 15:45:21 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. Apr 14 15:45:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-8bb68223-3f19-4316-ba81-d2a8b3b00c69 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Returning 404 to user: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:45:21 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-8bb68223-3f19-4316-ba81-d2a8b3b00c69 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" status: 404 len: 111 microversion: 2.1 time: 0.047639 Apr 14 15:45:21 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 162/487] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:45:21 2023] GET /compute/v2.1/servers/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:21 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a" status: 204 len: 0 microversion: 2.1 time: 0.145545 Apr 14 15:45:21 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 162/488] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:45:21 2023] DELETE /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-db4b0069-5ce4-42a4-881f-8a18814c18df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'services' on Instance uuid 203e4039-aa71-4521-8e74-02452436cb60 {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-db4b0069-5ce4-42a4-881f-8a18814c18df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-db4b0069-5ce4-42a4-881f-8a18814c18df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-db4b0069-5ce4-42a4-881f-8a18814c18df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-db4b0069-5ce4-42a4-881f-8a18814c18df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-db4b0069-5ce4-42a4-881f-8a18814c18df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-db4b0069-5ce4-42a4-881f-8a18814c18df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-db4b0069-5ce4-42a4-881f-8a18814c18df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60/os-volume_attachments/e0991f31-aa0c-498b-934c-109652675c69" status: 202 len: 0 microversion: 2.1 time: 0.206045 Apr 14 15:45:21 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 165/489] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:45:21 2023] DELETE /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60/os-volume_attachments/e0991f31-aa0c-498b-934c-109652675c69 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-08426480-4d41-4ea1-8eae-60d5a9ad2ce7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-08426480-4d41-4ea1-8eae-60d5a9ad2ce7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08426480-4d41-4ea1-8eae-60d5a9ad2ce7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08426480-4d41-4ea1-8eae-60d5a9ad2ce7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08426480-4d41-4ea1-8eae-60d5a9ad2ce7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08426480-4d41-4ea1-8eae-60d5a9ad2ce7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08426480-4d41-4ea1-8eae-60d5a9ad2ce7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08426480-4d41-4ea1-8eae-60d5a9ad2ce7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:21 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-08426480-4d41-4ea1-8eae-60d5a9ad2ce7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044517 Apr 14 15:45:21 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 163/490] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:45:21 2023] GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:21 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-db4b0069-5ce4-42a4-881f-8a18814c18df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af824b840c604223afd90bce17fe1ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e73ef2ad94e84876def53ddf43da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:45:21 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-db4b0069-5ce4-42a4-881f-8a18814c18df tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a" status: 200 len: 1500 microversion: 2.1 time: 0.325387 Apr 14 15:45:21 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 163/491] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:45:21 2023] GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a => generated 1500 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-acde2941-e9e9-4983-8fdb-c83a3106b5c1 req-b36bba24-2d85-45ad-b894-169fdb098666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0339b7d6-294b-4669-9782-51de5748226a", "name": "network-vif-unplugged", "status": "completed", "tag": "29225f48-b889-4b7d-b5be-6c47f5c4b076"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-acde2941-e9e9-4983-8fdb-c83a3106b5c1 req-b36bba24-2d85-45ad-b894-169fdb098666 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-acde2941-e9e9-4983-8fdb-c83a3106b5c1 req-b36bba24-2d85-45ad-b894-169fdb098666 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-acde2941-e9e9-4983-8fdb-c83a3106b5c1 req-b36bba24-2d85-45ad-b894-169fdb098666 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-acde2941-e9e9-4983-8fdb-c83a3106b5c1 req-b36bba24-2d85-45ad-b894-169fdb098666 service nova] Creating event network-vif-unplugged:29225f48-b889-4b7d-b5be-6c47f5c4b076 for instance 0339b7d6-294b-4669-9782-51de5748226a on user Apr 14 15:45:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-acde2941-e9e9-4983-8fdb-c83a3106b5c1 req-b36bba24-2d85-45ad-b894-169fdb098666 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033252 Apr 14 15:45:21 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 166/492] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:45:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:23 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0339b7d6-294b-4669-9782-51de5748226a", "name": "network-vif-plugged", "status": "completed", "tag": "29225f48-b889-4b7d-b5be-6c47f5c4b076"}, {"name": "network-changed", "server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}, {"server_uuid": "0339b7d6-294b-4669-9782-51de5748226a", "name": "network-vif-deleted", "tag": "29225f48-b889-4b7d-b5be-6c47f5c4b076"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:23 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:23 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:23 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:23 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] Creating event network-vif-plugged:29225f48-b889-4b7d-b5be-6c47f5c4b076 for instance 0339b7d6-294b-4669-9782-51de5748226a on user Apr 14 15:45:23 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] Creating event network-changed:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:45:23 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] Creating event network-vif-deleted:29225f48-b889-4b7d-b5be-6c47f5c4b076 for instance 0339b7d6-294b-4669-9782-51de5748226a on user Apr 14 15:45:23 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.049984 Apr 14 15:45:23 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 164/493] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:45:23 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:25 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-b63b581a-a16f-40aa-b09b-61c3fd72ee7d req-2f383e1f-4705-4ef0-a2e2-20a4a234ca77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "name": "network-vif-plugged", "status": "completed", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b63b581a-a16f-40aa-b09b-61c3fd72ee7d req-2f383e1f-4705-4ef0-a2e2-20a4a234ca77 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b63b581a-a16f-40aa-b09b-61c3fd72ee7d req-2f383e1f-4705-4ef0-a2e2-20a4a234ca77 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b63b581a-a16f-40aa-b09b-61c3fd72ee7d req-2f383e1f-4705-4ef0-a2e2-20a4a234ca77 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-b63b581a-a16f-40aa-b09b-61c3fd72ee7d req-2f383e1f-4705-4ef0-a2e2-20a4a234ca77 service nova] Creating event network-vif-plugged:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:45:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-b63b581a-a16f-40aa-b09b-61c3fd72ee7d req-2f383e1f-4705-4ef0-a2e2-20a4a234ca77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037915 Apr 14 15:45:25 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 164/494] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:45:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:27 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:27 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-f20994c5-c144-444c-971a-5c8cbae335ee req-fb6f0dfd-8aa0-48ea-9253-2188109c6950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "name": "network-vif-plugged", "status": "completed", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-f20994c5-c144-444c-971a-5c8cbae335ee req-fb6f0dfd-8aa0-48ea-9253-2188109c6950 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-f20994c5-c144-444c-971a-5c8cbae335ee req-fb6f0dfd-8aa0-48ea-9253-2188109c6950 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-f20994c5-c144-444c-971a-5c8cbae335ee req-fb6f0dfd-8aa0-48ea-9253-2188109c6950 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:27 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-f20994c5-c144-444c-971a-5c8cbae335ee req-fb6f0dfd-8aa0-48ea-9253-2188109c6950 service nova] Creating event network-vif-plugged:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:45:27 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-f20994c5-c144-444c-971a-5c8cbae335ee req-fb6f0dfd-8aa0-48ea-9253-2188109c6950 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034338 Apr 14 15:45:27 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 167/495] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:45:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:34 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:34 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:34 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:34 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:34 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:34 user devstack@n-api.service[61875]: DEBUG nova.objects.instance [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'services' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=61875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:45:34 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments/597dad96-7242-4822-9c01-a5d1681ce980" status: 202 len: 0 microversion: 2.1 time: 0.259775 Apr 14 15:45:34 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 165/496] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:45:34 2023] DELETE /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments/597dad96-7242-4822-9c01-a5d1681ce980 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:45:34 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:34 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:34 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-824327f5-40c3-4336-826c-7af24f18846b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:34 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-824327f5-40c3-4336-826c-7af24f18846b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-824327f5-40c3-4336-826c-7af24f18846b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-824327f5-40c3-4336-826c-7af24f18846b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-824327f5-40c3-4336-826c-7af24f18846b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-824327f5-40c3-4336-826c-7af24f18846b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-824327f5-40c3-4336-826c-7af24f18846b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-824327f5-40c3-4336-826c-7af24f18846b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-824327f5-40c3-4336-826c-7af24f18846b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093770 Apr 14 15:45:34 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 165/497] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:45:34 2023] GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:35 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-4242c29f-660e-4013-afe1-e35a90952faa tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1244790362"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:35 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-4242c29f-660e-4013-afe1-e35a90952faa tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4242c29f-660e-4013-afe1-e35a90952faa tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4242c29f-660e-4013-afe1-e35a90952faa tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4242c29f-660e-4013-afe1-e35a90952faa tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4242c29f-660e-4013-afe1-e35a90952faa tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4242c29f-660e-4013-afe1-e35a90952faa tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4242c29f-660e-4013-afe1-e35a90952faa tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:35 user devstack@n-api.service[61876]: INFO nova.network.security_group_api [None req-4242c29f-660e-4013-afe1-e35a90952faa tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Removing security group 724ba491-cc3e-4c14-83ea-9025d5fd9e0d from port 05127b2a-2e86-4f6a-9fb3-9e2be5559bde Apr 14 15:45:36 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-4242c29f-660e-4013-afe1-e35a90952faa tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/action" status: 202 len: 0 microversion: 2.1 time: 1.140341 Apr 14 15:45:36 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 168/498] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:45:35 2023] POST /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/action => generated 0 bytes in 1144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:45:36 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] Creating event network-changed:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:45:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053839 Apr 14 15:45:36 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 166/499] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:45:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:37 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] Creating event network-changed:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:45:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039852 Apr 14 15:45:37 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 166/500] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:45:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:37 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:37 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:37 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'services' on Instance uuid d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:45:38 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/os-volume_attachments/25aefab3-a41b-41a7-bc7c-4f07017f7305" status: 202 len: 0 microversion: 2.1 time: 0.211205 Apr 14 15:45:38 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 169/501] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:45:37 2023] DELETE /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/os-volume_attachments/25aefab3-a41b-41a7-bc7c-4f07017f7305 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:45:38 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-fc6ea491-bb6d-4b4a-b2bf-94952fd45e3c tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:38 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-fc6ea491-bb6d-4b4a-b2bf-94952fd45e3c tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fc6ea491-bb6d-4b4a-b2bf-94952fd45e3c tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fc6ea491-bb6d-4b4a-b2bf-94952fd45e3c tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fc6ea491-bb6d-4b4a-b2bf-94952fd45e3c tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fc6ea491-bb6d-4b4a-b2bf-94952fd45e3c tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fc6ea491-bb6d-4b4a-b2bf-94952fd45e3c tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fc6ea491-bb6d-4b4a-b2bf-94952fd45e3c tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-fc6ea491-bb6d-4b4a-b2bf-94952fd45e3c tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051749 Apr 14 15:45:38 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 167/502] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:45:38 2023] GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:45:38 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-6ff23a4e-6efa-4803-873f-e0c7c0805070 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:45:38 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-6ff23a4e-6efa-4803-873f-e0c7c0805070 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:45:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6ff23a4e-6efa-4803-873f-e0c7c0805070 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6ff23a4e-6efa-4803-873f-e0c7c0805070 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6ff23a4e-6efa-4803-873f-e0c7c0805070 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6ff23a4e-6efa-4803-873f-e0c7c0805070 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:45:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6ff23a4e-6efa-4803-873f-e0c7c0805070 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:45:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6ff23a4e-6efa-4803-873f-e0c7c0805070 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:45:38 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-6ff23a4e-6efa-4803-873f-e0c7c0805070 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:45:38 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-6ff23a4e-6efa-4803-873f-e0c7c0805070 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1722 microversion: 2.1 time: 0.315431 Apr 14 15:45:38 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 167/503] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:45:38 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:45:59 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:59 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:45:59 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1749968002", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "7c17386f-ee51-4b70-936e-ca90f2fb5615"}]}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:45:59 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] validate_networks() for [('7c17386f-ee51-4b70-936e-ca90f2fb5615', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting quotas for project 584a53650c014f87b9622f2011996200. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting quotas for user efb645d110464e7e85d7c955ee9f3466 and project 584a53650c014f87b9622f2011996200. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:46:00 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:46:00 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.707535 Apr 14 15:46:00 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 170/504] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 15:45:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 15:46:00 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f004a0d2-7f2a-48dc-af5e-b40c6a1aa0c1 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:00 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-f004a0d2-7f2a-48dc-af5e-b40c6a1aa0c1 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:00 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:00 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:00 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-f004a0d2-7f2a-48dc-af5e-b40c6a1aa0c1 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:46:00 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-f004a0d2-7f2a-48dc-af5e-b40c6a1aa0c1 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:46:00 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-f004a0d2-7f2a-48dc-af5e-b40c6a1aa0c1 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:46:00 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-f004a0d2-7f2a-48dc-af5e-b40c6a1aa0c1 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583" status: 200 len: 1395 microversion: 2.87 time: 0.094274 Apr 14 15:46:00 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 168/505] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:46:00 2023] GET /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583 => generated 1395 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:46:03 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae5542b8-ac5f-40a6-bbff-8a2734a01583", "tag": "cd9b8743-1e76-4694-91d4-4420b8e16ce2"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:03 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:03 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=25 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:03 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] Creating event network-changed:cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 on user Apr 14 15:46:03 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032696 Apr 14 15:46:03 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 168/506] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:46:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:46:05 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-4449f8d3-b3d1-40bd-bf97-47d9a7f60d96 req-bec4be49-ed05-438f-981c-cd23e7f1fec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5542b8-ac5f-40a6-bbff-8a2734a01583", "name": "network-vif-plugged", "status": "completed", "tag": "cd9b8743-1e76-4694-91d4-4420b8e16ce2"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-4449f8d3-b3d1-40bd-bf97-47d9a7f60d96 req-bec4be49-ed05-438f-981c-cd23e7f1fec4 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-4449f8d3-b3d1-40bd-bf97-47d9a7f60d96 req-bec4be49-ed05-438f-981c-cd23e7f1fec4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-4449f8d3-b3d1-40bd-bf97-47d9a7f60d96 req-bec4be49-ed05-438f-981c-cd23e7f1fec4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:05 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-4449f8d3-b3d1-40bd-bf97-47d9a7f60d96 req-bec4be49-ed05-438f-981c-cd23e7f1fec4 service nova] Creating event network-vif-plugged:cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 on user Apr 14 15:46:05 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-4449f8d3-b3d1-40bd-bf97-47d9a7f60d96 req-bec4be49-ed05-438f-981c-cd23e7f1fec4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048485 Apr 14 15:46:05 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 171/507] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:46:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:46:07 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-318eb981-2e77-4454-af71-be93eafdd42a req-2638213c-8740-481c-8a04-01af943bd151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5542b8-ac5f-40a6-bbff-8a2734a01583", "name": "network-vif-plugged", "status": "completed", "tag": "cd9b8743-1e76-4694-91d4-4420b8e16ce2"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-318eb981-2e77-4454-af71-be93eafdd42a req-2638213c-8740-481c-8a04-01af943bd151 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-318eb981-2e77-4454-af71-be93eafdd42a req-2638213c-8740-481c-8a04-01af943bd151 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-318eb981-2e77-4454-af71-be93eafdd42a req-2638213c-8740-481c-8a04-01af943bd151 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:07 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-318eb981-2e77-4454-af71-be93eafdd42a req-2638213c-8740-481c-8a04-01af943bd151 service nova] Creating event network-vif-plugged:cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 on user Apr 14 15:46:07 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-318eb981-2e77-4454-af71-be93eafdd42a req-2638213c-8740-481c-8a04-01af943bd151 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036069 Apr 14 15:46:07 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 169/508] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:46:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:46:09 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-be6622c3-dbf4-498e-be15-5242e6976e30 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:09 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-be6622c3-dbf4-498e-be15-5242e6976e30 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-be6622c3-dbf4-498e-be15-5242e6976e30 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-be6622c3-dbf4-498e-be15-5242e6976e30 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-be6622c3-dbf4-498e-be15-5242e6976e30 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-be6622c3-dbf4-498e-be15-5242e6976e30 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-be6622c3-dbf4-498e-be15-5242e6976e30 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-be6622c3-dbf4-498e-be15-5242e6976e30 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:09 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-be6622c3-dbf4-498e-be15-5242e6976e30 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:46:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-be6622c3-dbf4-498e-be15-5242e6976e30 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" status: 200 len: 1552 microversion: 2.1 time: 0.251955 Apr 14 15:46:09 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 169/509] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:46:09 2023] GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => generated 1552 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:46:11 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:11 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:11 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-2ccefb15-1182-4316-8def-cafa8358e893 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:11 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-2ccefb15-1182-4316-8def-cafa8358e893 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2ccefb15-1182-4316-8def-cafa8358e893 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2ccefb15-1182-4316-8def-cafa8358e893 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2ccefb15-1182-4316-8def-cafa8358e893 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2ccefb15-1182-4316-8def-cafa8358e893 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2ccefb15-1182-4316-8def-cafa8358e893 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2ccefb15-1182-4316-8def-cafa8358e893 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:11 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-2ccefb15-1182-4316-8def-cafa8358e893 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058590 Apr 14 15:46:11 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 172/510] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:46:11 2023] GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:46:11 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:11 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-83f14271-f1fc-4165-a35d-a0e5d33fcf5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:11 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-83f14271-f1fc-4165-a35d-a0e5d33fcf5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-83f14271-f1fc-4165-a35d-a0e5d33fcf5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-83f14271-f1fc-4165-a35d-a0e5d33fcf5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-83f14271-f1fc-4165-a35d-a0e5d33fcf5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-83f14271-f1fc-4165-a35d-a0e5d33fcf5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-83f14271-f1fc-4165-a35d-a0e5d33fcf5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-83f14271-f1fc-4165-a35d-a0e5d33fcf5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:11 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-83f14271-f1fc-4165-a35d-a0e5d33fcf5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] HTTP exception thrown: Instance 0339b7d6-294b-4669-9782-51de5748226a could not be found. Apr 14 15:46:11 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-83f14271-f1fc-4165-a35d-a0e5d33fcf5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Request method failure captured: Apr 14 15:46:11 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a HTTP/1.1 Apr 14 15:46:11 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:46:11 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:46:11 user devstack@n-api.service[61875]: Connection: close Apr 14 15:46:11 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:46:11 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:46:11 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:46:11 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:46:11 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXL95JWLmONfTrhpJmmUWoidh6SxM6nOj4T6nb8eiCzGyQ8xri5QYFuYNhdtZLUHL4oGnJqSuEepZDj66OEbgJzZJeiNKYrkGdM78HBIq2CBd_mG7YSrfK2eef4zoe0o--DIA0Ny5tXerL6dbd4mO3kxcJGCA4XuQGooGSa-qHGlW8A Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Project-Id: 3a8e73ef2ad94e84876def53ddf43da4 Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Project-Name: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8e73ef2ad94e84876def53ddf43da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Tenant: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Tenant-Id: 3a8e73ef2ad94e84876def53ddf43da4 Apr 14 15:46:11 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-443911091 Apr 14 15:46:11 user devstack@n-api.service[61875]: X-User: tempest-ServersNegativeTestJSON-443911091-project-member Apr 14 15:46:11 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:46:11 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:46:11 user devstack@n-api.service[61875]: X-User-Id: af824b840c604223afd90bce17fe1ceb Apr 14 15:46:11 user devstack@n-api.service[61875]: X-User-Name: tempest-ServersNegativeTestJSON-443911091-project-member Apr 14 15:46:11 user devstack@n-api.service[61875]: method: > Apr 14 15:46:11 user devstack@n-api.service[61875]: exception: Instance 0339b7d6-294b-4669-9782-51de5748226a could not be found. Apr 14 15:46:11 user devstack@n-api.service[61875]: action_args: {'id': '0339b7d6-294b-4669-9782-51de5748226a'} Apr 14 15:46:11 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0339b7d6-294b-4669-9782-51de5748226a could not be found. Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0339b7d6-294b-4669-9782-51de5748226a could not be found. Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0339b7d6-294b-4669-9782-51de5748226a could not be found. Apr 14 15:46:11 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:46:11 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-83f14271-f1fc-4165-a35d-a0e5d33fcf5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Returning 404 to user: Instance 0339b7d6-294b-4669-9782-51de5748226a could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:46:11 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-83f14271-f1fc-4165-a35d-a0e5d33fcf5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a" status: 404 len: 111 microversion: 2.1 time: 0.030875 Apr 14 15:46:11 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 170/511] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:46:11 2023] GET /compute/v2.1/servers/0339b7d6-294b-4669-9782-51de5748226a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:46:14 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-277783302"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:14 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:15 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "POST /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60/action" status: 202 len: 0 microversion: 2.1 time: 0.907028 Apr 14 15:46:15 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 170/512] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:46:14 2023] POST /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60/action => generated 0 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 449 bytes (2 switches on core 0) Apr 14 15:46:23 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:23 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=10 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:23 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-f30faa3d-90e6-409e-8999-c5e0ee896a65 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Action: 'create', calling method: .version_select at 0x7f29709ced40>, body: {"keypair": {"name": "tempest-keypair-734921168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgvijkP8DXBLhB2Q6gSjDQlgdGG1K/hc5mEyvzpItomHSAx/m7M9p6C6PokLp3qjcl2Vz4ujRoHQ99AsdBXb4Dcvlh8N4ZLw2mXfulDnVOgLSfRu3trzwk0GeMc6FBpuQ=="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:23 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-f30faa3d-90e6-409e-8999-c5e0ee896a65 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting quotas for project 534f0fb654694b079fa89150594e1bbb. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:46:23 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-f30faa3d-90e6-409e-8999-c5e0ee896a65 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting quotas for user b44feacbb8fa4680a965953c122cf31c and project 534f0fb654694b079fa89150594e1bbb. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:46:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-f30faa3d-90e6-409e-8999-c5e0ee896a65 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.211473 Apr 14 15:46:23 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 173/513] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 15:46:23 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:46:24 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-caf1ece7-3108-4b49-82c7-3396c34735a9 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:24 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-caf1ece7-3108-4b49-82c7-3396c34735a9 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:24 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=10 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:24 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-caf1ece7-3108-4b49-82c7-3396c34735a9 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-caf1ece7-3108-4b49-82c7-3396c34735a9 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-caf1ece7-3108-4b49-82c7-3396c34735a9 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-caf1ece7-3108-4b49-82c7-3396c34735a9 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-caf1ece7-3108-4b49-82c7-3396c34735a9 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-caf1ece7-3108-4b49-82c7-3396c34735a9 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-caf1ece7-3108-4b49-82c7-3396c34735a9 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063031 Apr 14 15:46:24 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 171/514] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:46:24 2023] GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-997161815", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a45284f5-dd61-4b82-8470-01fa75cb3923"}], "security_groups": [{"name": "tempest-securitygroup--310847592"}], "key_name": "tempest-keypair-734921168", "user_data": "}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] validate_networks() for [('a45284f5-dd61-4b82-8470-01fa75cb3923', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting quotas for project 534f0fb654694b079fa89150594e1bbb. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting quotas for user b44feacbb8fa4680a965953c122cf31c and project 534f0fb654694b079fa89150594e1bbb. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:46:25 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-91157443", "imageRef": "26e27121-f671-4e7f-8bb6-e13ff6acefb9", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1517680664", "security_groups": [{"name": "tempest-secgroup-smoke-1075360313"}], "networks": [{"uuid": "ede18487-777c-44d7-94ad-f2452fbc753e"}]}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:26 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.938004 Apr 14 15:46:26 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 171/515] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:46:25 2023] POST /compute/v2.1/servers => generated 399 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:46:26 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-fe7fa853-8001-4813-a514-344719d8f4ca tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:26 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-fe7fa853-8001-4813-a514-344719d8f4ca tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:26 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-fe7fa853-8001-4813-a514-344719d8f4ca tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:46:26 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-fe7fa853-8001-4813-a514-344719d8f4ca tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 200 len: 1230 microversion: 2.1 time: 0.097623 Apr 14 15:46:26 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 172/516] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:46:26 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] validate_networks() for [('ede18487-777c-44d7-94ad-f2452fbc753e', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Getting quotas for project d1ac7fb012e144cdaa7da36ee9b590a0. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Getting quotas for user 855c585696694964974a8df948ab7899 and project d1ac7fb012e144cdaa7da36ee9b590a0. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:46:26 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e27121-f671-4e7f-8bb6-e13ff6acefb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:46:26 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.881165 Apr 14 15:46:26 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 174/517] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:46:26 2023] POST /compute/v2.1/servers => generated 404 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:46:26 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-27264919-4596-4fbb-9003-5125e4dd6e91 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:26 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-27264919-4596-4fbb-9003-5125e4dd6e91 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:27 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-27264919-4596-4fbb-9003-5125e4dd6e91 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855c585696694964974a8df948ab7899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac7fb012e144cdaa7da36ee9b590a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:46:27 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-27264919-4596-4fbb-9003-5125e4dd6e91 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc" status: 200 len: 1235 microversion: 2.1 time: 0.065147 Apr 14 15:46:27 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 172/518] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:46:26 2023] GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc => generated 1235 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:46:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-9628d82a-fba5-4215-8a24-a58951172c8f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:28 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-9628d82a-fba5-4215-8a24-a58951172c8f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9628d82a-fba5-4215-8a24-a58951172c8f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9628d82a-fba5-4215-8a24-a58951172c8f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9628d82a-fba5-4215-8a24-a58951172c8f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9628d82a-fba5-4215-8a24-a58951172c8f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9628d82a-fba5-4215-8a24-a58951172c8f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9628d82a-fba5-4215-8a24-a58951172c8f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-9628d82a-fba5-4215-8a24-a58951172c8f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.238783 Apr 14 15:46:28 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 173/519] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:46:28 2023] GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/os-volume_attachments => generated 25 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:46:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-84f2b36b-352d-44bb-bc4c-b1df28aca834 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:28 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-84f2b36b-352d-44bb-bc4c-b1df28aca834 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-84f2b36b-352d-44bb-bc4c-b1df28aca834 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-84f2b36b-352d-44bb-bc4c-b1df28aca834 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-84f2b36b-352d-44bb-bc4c-b1df28aca834 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-84f2b36b-352d-44bb-bc4c-b1df28aca834 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-84f2b36b-352d-44bb-bc4c-b1df28aca834 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-84f2b36b-352d-44bb-bc4c-b1df28aca834 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-84f2b36b-352d-44bb-bc4c-b1df28aca834 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] HTTP exception thrown: Instance d7088d6e-b443-4c76-8a13-199e0721ea36 is not attached to volume 25aefab3-a41b-41a7-bc7c-4f07017f7305 Apr 14 15:46:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-84f2b36b-352d-44bb-bc4c-b1df28aca834 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Request method failure captured: Apr 14 15:46:28 user devstack@n-api.service[61876]: request: DELETE /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/os-volume_attachments/25aefab3-a41b-41a7-bc7c-4f07017f7305 HTTP/1.1 Apr 14 15:46:28 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:46:28 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:46:28 user devstack@n-api.service[61876]: Connection: close Apr 14 15:46:28 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:46:28 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:46:28 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:46:28 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:46:28 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXQfuRe5Mx84pROzOPxXeB-PImcZqKH5R_6m5AwP3qCwwe0KmwOb4TFi8y6SMuALTDcSTknRD1fri0QgjYfA6wpM3bXvPSZBB6hPCxoBzTLpQY2P1GzJ7jp7ivNmM-vc9faSmLpkqMW80qGNJRDohvFywVJlTvOwoteimMsLFvejs-M Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Project-Id: 6d21cbc9fcc74fdd8579bad00a8ba2eb Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Project-Name: tempest-TestMinimumBasicScenario-554859149 Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d21cbc9fcc74fdd8579bad00a8ba2eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d21cbc9fcc74fdd8579bad00a8ba2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d21cbc9fcc74fdd8579bad00a8ba2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Tenant: tempest-TestMinimumBasicScenario-554859149 Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Tenant-Id: 6d21cbc9fcc74fdd8579bad00a8ba2eb Apr 14 15:46:28 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-TestMinimumBasicScenario-554859149 Apr 14 15:46:28 user devstack@n-api.service[61876]: X-User: tempest-TestMinimumBasicScenario-554859149-project-member Apr 14 15:46:28 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:46:28 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:46:28 user devstack@n-api.service[61876]: X-User-Id: 4e5d615d61ea4b1dafa4207d7b21e2d5 Apr 14 15:46:28 user devstack@n-api.service[61876]: X-User-Name: tempest-TestMinimumBasicScenario-554859149-project-member Apr 14 15:46:28 user devstack@n-api.service[61876]: method: > Apr 14 15:46:28 user devstack@n-api.service[61876]: exception: Instance d7088d6e-b443-4c76-8a13-199e0721ea36 is not attached to volume 25aefab3-a41b-41a7-bc7c-4f07017f7305 Apr 14 15:46:28 user devstack@n-api.service[61876]: action_args: {'server_id': 'd7088d6e-b443-4c76-8a13-199e0721ea36', 'id': '25aefab3-a41b-41a7-bc7c-4f07017f7305'} Apr 14 15:46:28 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 25aefab3-a41b-41a7-bc7c-4f07017f7305. Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7088d6e-b443-4c76-8a13-199e0721ea36 is not attached to volume 25aefab3-a41b-41a7-bc7c-4f07017f7305 Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7088d6e-b443-4c76-8a13-199e0721ea36 is not attached to volume 25aefab3-a41b-41a7-bc7c-4f07017f7305 Apr 14 15:46:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:46:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-84f2b36b-352d-44bb-bc4c-b1df28aca834 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Returning 404 to user: Instance d7088d6e-b443-4c76-8a13-199e0721ea36 is not attached to volume 25aefab3-a41b-41a7-bc7c-4f07017f7305 {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:46:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-84f2b36b-352d-44bb-bc4c-b1df28aca834 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/os-volume_attachments/25aefab3-a41b-41a7-bc7c-4f07017f7305" status: 404 len: 154 microversion: 2.1 time: 0.099388 Apr 14 15:46:28 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 175/520] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:46:28 2023] DELETE /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36/os-volume_attachments/25aefab3-a41b-41a7-bc7c-4f07017f7305 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:46:28 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de10ecef-ee3e-4c88-8a81-e05f9b748a1f"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:28 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:29 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:29 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] Creating event network-changed:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:46:29 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030001 Apr 14 15:46:29 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 174/521] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:46:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:46:29 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.050326 Apr 14 15:46:29 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 173/522] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:46:28 2023] POST /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments => generated 194 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:46:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af42177f-7597-4b26-8c8b-27f37a044cfc", "tag": "e2569358-6e39-46e0-a34b-6f67930a0295"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] Creating event network-changed:e2569358-6e39-46e0-a34b-6f67930a0295 for instance af42177f-7597-4b26-8c8b-27f37a044cfc on user Apr 14 15:46:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055039 Apr 14 15:46:31 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 176/523] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:46:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:46:32 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-4d122cfc-3e0a-4e77-b2e8-8dadc278d71a req-1dee9729-a5cc-428c-8bb6-0e10422e32ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-plugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-4d122cfc-3e0a-4e77-b2e8-8dadc278d71a req-1dee9729-a5cc-428c-8bb6-0e10422e32ab service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-4d122cfc-3e0a-4e77-b2e8-8dadc278d71a req-1dee9729-a5cc-428c-8bb6-0e10422e32ab service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-4d122cfc-3e0a-4e77-b2e8-8dadc278d71a req-1dee9729-a5cc-428c-8bb6-0e10422e32ab service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-4d122cfc-3e0a-4e77-b2e8-8dadc278d71a req-1dee9729-a5cc-428c-8bb6-0e10422e32ab service nova] Creating event network-vif-plugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:46:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-4d122cfc-3e0a-4e77-b2e8-8dadc278d71a req-1dee9729-a5cc-428c-8bb6-0e10422e32ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054796 Apr 14 15:46:32 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 175/524] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:46:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:46:32 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:32 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:32 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:46:33 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36" status: 204 len: 0 microversion: 2.1 time: 0.140379 Apr 14 15:46:33 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 174/525] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:46:32 2023] DELETE /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:46:33 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-a9104bec-cab1-4b12-b9d1-67ae1e598ab9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:33 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-a9104bec-cab1-4b12-b9d1-67ae1e598ab9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a9104bec-cab1-4b12-b9d1-67ae1e598ab9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a9104bec-cab1-4b12-b9d1-67ae1e598ab9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a9104bec-cab1-4b12-b9d1-67ae1e598ab9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a9104bec-cab1-4b12-b9d1-67ae1e598ab9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a9104bec-cab1-4b12-b9d1-67ae1e598ab9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a9104bec-cab1-4b12-b9d1-67ae1e598ab9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:33 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-a9104bec-cab1-4b12-b9d1-67ae1e598ab9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:46:33 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-a9104bec-cab1-4b12-b9d1-67ae1e598ab9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36" status: 200 len: 1543 microversion: 2.1 time: 0.339709 Apr 14 15:46:33 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 177/526] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:46:33 2023] GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36 => generated 1543 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:46:33 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-5f9212cd-ea4c-476a-ade8-3f76a2727795 req-479098eb-eb35-485e-a572-7b1d7ed1ba99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "name": "network-vif-unplugged", "status": "completed", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5f9212cd-ea4c-476a-ade8-3f76a2727795 req-479098eb-eb35-485e-a572-7b1d7ed1ba99 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5f9212cd-ea4c-476a-ade8-3f76a2727795 req-479098eb-eb35-485e-a572-7b1d7ed1ba99 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5f9212cd-ea4c-476a-ade8-3f76a2727795 req-479098eb-eb35-485e-a572-7b1d7ed1ba99 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:33 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-5f9212cd-ea4c-476a-ade8-3f76a2727795 req-479098eb-eb35-485e-a572-7b1d7ed1ba99 service nova] Creating event network-vif-unplugged:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:46:33 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-5f9212cd-ea4c-476a-ade8-3f76a2727795 req-479098eb-eb35-485e-a572-7b1d7ed1ba99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032965 Apr 14 15:46:33 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 176/527] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:46:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:46:34 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-plugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}, {"server_uuid": "af42177f-7597-4b26-8c8b-27f37a044cfc", "name": "network-vif-plugged", "status": "completed", "tag": "e2569358-6e39-46e0-a34b-6f67930a0295"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] Creating event network-vif-plugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:46:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] Creating event network-vif-plugged:e2569358-6e39-46e0-a34b-6f67930a0295 for instance af42177f-7597-4b26-8c8b-27f37a044cfc on user Apr 14 15:46:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066055 Apr 14 15:46:34 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 175/528] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:46:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:46:35 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-9543f9a1-e85b-442c-9f73-8aa1161696bb req-7408fdfe-902e-44ec-aae6-ee8ff2d75178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "name": "network-vif-deleted", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9543f9a1-e85b-442c-9f73-8aa1161696bb req-7408fdfe-902e-44ec-aae6-ee8ff2d75178 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9543f9a1-e85b-442c-9f73-8aa1161696bb req-7408fdfe-902e-44ec-aae6-ee8ff2d75178 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9543f9a1-e85b-442c-9f73-8aa1161696bb req-7408fdfe-902e-44ec-aae6-ee8ff2d75178 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:35 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-9543f9a1-e85b-442c-9f73-8aa1161696bb req-7408fdfe-902e-44ec-aae6-ee8ff2d75178 service nova] Creating event network-vif-deleted:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:46:35 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-9543f9a1-e85b-442c-9f73-8aa1161696bb req-7408fdfe-902e-44ec-aae6-ee8ff2d75178 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064700 Apr 14 15:46:35 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 178/529] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:46:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:46:35 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-0a27d278-62fd-47c6-95c6-90a925591e4b req-20dbef9b-1b9b-4ae1-92bc-215044238c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7088d6e-b443-4c76-8a13-199e0721ea36", "name": "network-vif-plugged", "status": "completed", "tag": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0a27d278-62fd-47c6-95c6-90a925591e4b req-20dbef9b-1b9b-4ae1-92bc-215044238c61 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0a27d278-62fd-47c6-95c6-90a925591e4b req-20dbef9b-1b9b-4ae1-92bc-215044238c61 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0a27d278-62fd-47c6-95c6-90a925591e4b req-20dbef9b-1b9b-4ae1-92bc-215044238c61 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-0a27d278-62fd-47c6-95c6-90a925591e4b req-20dbef9b-1b9b-4ae1-92bc-215044238c61 service nova] Creating event network-vif-plugged:05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance d7088d6e-b443-4c76-8a13-199e0721ea36 on user Apr 14 15:46:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-0a27d278-62fd-47c6-95c6-90a925591e4b req-20dbef9b-1b9b-4ae1-92bc-215044238c61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051653 Apr 14 15:46:35 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 177/530] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:46:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:46:36 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:36 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-5c356bb3-8d32-4af9-b9b5-7fe3db2ce2e5 req-aec03ec0-ca0c-41e8-9140-86ee65b98394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af42177f-7597-4b26-8c8b-27f37a044cfc", "name": "network-vif-plugged", "status": "completed", "tag": "e2569358-6e39-46e0-a34b-6f67930a0295"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:46:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-5c356bb3-8d32-4af9-b9b5-7fe3db2ce2e5 req-aec03ec0-ca0c-41e8-9140-86ee65b98394 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-5c356bb3-8d32-4af9-b9b5-7fe3db2ce2e5 req-aec03ec0-ca0c-41e8-9140-86ee65b98394 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-5c356bb3-8d32-4af9-b9b5-7fe3db2ce2e5 req-aec03ec0-ca0c-41e8-9140-86ee65b98394 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:36 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-5c356bb3-8d32-4af9-b9b5-7fe3db2ce2e5 req-aec03ec0-ca0c-41e8-9140-86ee65b98394 service nova] Creating event network-vif-plugged:e2569358-6e39-46e0-a34b-6f67930a0295 for instance af42177f-7597-4b26-8c8b-27f37a044cfc on user Apr 14 15:46:36 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-5c356bb3-8d32-4af9-b9b5-7fe3db2ce2e5 req-aec03ec0-ca0c-41e8-9140-86ee65b98394 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047819 Apr 14 15:46:36 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 176/531] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:46:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:46:38 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:38 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=10 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:39 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-fa967500-f4e9-4829-a699-79b7536c4cd7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:39 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-fa967500-f4e9-4829-a699-79b7536c4cd7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fa967500-f4e9-4829-a699-79b7536c4cd7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fa967500-f4e9-4829-a699-79b7536c4cd7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fa967500-f4e9-4829-a699-79b7536c4cd7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fa967500-f4e9-4829-a699-79b7536c4cd7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fa967500-f4e9-4829-a699-79b7536c4cd7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fa967500-f4e9-4829-a699-79b7536c4cd7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG nova.objects.instance [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'services' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=61875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:46:39 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments/de10ecef-ee3e-4c88-8a81-e05f9b748a1f" status: 202 len: 0 microversion: 2.1 time: 0.386203 Apr 14 15:46:39 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 178/532] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:46:39 2023] DELETE /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments/de10ecef-ee3e-4c88-8a81-e05f9b748a1f => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:46:39 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=8 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:39 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-f919c558-6c3d-459d-b650-9eac2d54f789 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:39 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-f919c558-6c3d-459d-b650-9eac2d54f789 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f919c558-6c3d-459d-b650-9eac2d54f789 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f919c558-6c3d-459d-b650-9eac2d54f789 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f919c558-6c3d-459d-b650-9eac2d54f789 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f919c558-6c3d-459d-b650-9eac2d54f789 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f919c558-6c3d-459d-b650-9eac2d54f789 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f919c558-6c3d-459d-b650-9eac2d54f789 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:39 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-f919c558-6c3d-459d-b650-9eac2d54f789 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051514 Apr 14 15:46:39 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 177/533] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:46:39 2023] GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:46:39 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-fa967500-f4e9-4829-a699-79b7536c4cd7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:46:39 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-fa967500-f4e9-4829-a699-79b7536c4cd7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1722 microversion: 2.1 time: 0.759840 Apr 14 15:46:39 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 179/534] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:46:38 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1722 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-be6af1ac-7f0d-4b1d-81a4-7b4dbaea43ce tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-be6af1ac-7f0d-4b1d-81a4-7b4dbaea43ce tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-be6af1ac-7f0d-4b1d-81a4-7b4dbaea43ce tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-be6af1ac-7f0d-4b1d-81a4-7b4dbaea43ce tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-be6af1ac-7f0d-4b1d-81a4-7b4dbaea43ce tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-be6af1ac-7f0d-4b1d-81a4-7b4dbaea43ce tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-be6af1ac-7f0d-4b1d-81a4-7b4dbaea43ce tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:39 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-be6af1ac-7f0d-4b1d-81a4-7b4dbaea43ce tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:40 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-be6af1ac-7f0d-4b1d-81a4-7b4dbaea43ce tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:46:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-be6af1ac-7f0d-4b1d-81a4-7b4dbaea43ce tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1722 microversion: 2.1 time: 0.244492 Apr 14 15:46:40 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 179/535] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:46:39 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:46:50 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-0b2e9581-7e70-4fc3-9578-be2b15cbb392 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:46:50 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-0b2e9581-7e70-4fc3-9578-be2b15cbb392 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:46:50 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:50 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:46:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0b2e9581-7e70-4fc3-9578-be2b15cbb392 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0b2e9581-7e70-4fc3-9578-be2b15cbb392 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0b2e9581-7e70-4fc3-9578-be2b15cbb392 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0b2e9581-7e70-4fc3-9578-be2b15cbb392 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:46:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0b2e9581-7e70-4fc3-9578-be2b15cbb392 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:46:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0b2e9581-7e70-4fc3-9578-be2b15cbb392 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:46:50 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-0b2e9581-7e70-4fc3-9578-be2b15cbb392 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:46:50 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-0b2e9581-7e70-4fc3-9578-be2b15cbb392 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:46:50 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-0b2e9581-7e70-4fc3-9578-be2b15cbb392 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:46:50 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-0b2e9581-7e70-4fc3-9578-be2b15cbb392 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583" status: 200 len: 1691 microversion: 2.87 time: 0.385357 Apr 14 15:46:50 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 178/536] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:46:50 2023] GET /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583 => generated 1691 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:47:09 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-7dc732cf-4713-4eaa-b926-50efd81ffea1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:47:09 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-7dc732cf-4713-4eaa-b926-50efd81ffea1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:09 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:09 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=24 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7dc732cf-4713-4eaa-b926-50efd81ffea1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7dc732cf-4713-4eaa-b926-50efd81ffea1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7dc732cf-4713-4eaa-b926-50efd81ffea1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7dc732cf-4713-4eaa-b926-50efd81ffea1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7dc732cf-4713-4eaa-b926-50efd81ffea1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7dc732cf-4713-4eaa-b926-50efd81ffea1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-7dc732cf-4713-4eaa-b926-50efd81ffea1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.179437 Apr 14 15:47:10 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 180/537] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 15:47:09 2023] GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-interface => generated 282 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:47:10 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:47:10 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=20 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:10 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:10 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] Creating event network-changed:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:47:10 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037081 Apr 14 15:47:10 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 180/538] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:47:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:47:10 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11765086-22f8-49da-9ddf-855ca5edd6c5"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:47:10 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:10 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:10 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:11 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307197 Apr 14 15:47:11 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 179/539] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:47:10 2023] POST /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:47:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-a517f603-3159-425c-8527-31c4940faab2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:47:16 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-a517f603-3159-425c-8527-31c4940faab2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a517f603-3159-425c-8527-31c4940faab2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a517f603-3159-425c-8527-31c4940faab2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a517f603-3159-425c-8527-31c4940faab2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a517f603-3159-425c-8527-31c4940faab2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a517f603-3159-425c-8527-31c4940faab2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a517f603-3159-425c-8527-31c4940faab2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:16 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-a517f603-3159-425c-8527-31c4940faab2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:47:16 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-a517f603-3159-425c-8527-31c4940faab2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 200 len: 1534 microversion: 2.1 time: 0.287020 Apr 14 15:47:16 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 181/540] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:47:16 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 1534 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:47:17 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-17a2c598-34aa-474c-80ec-92409bc66458 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:47:17 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-17a2c598-34aa-474c-80ec-92409bc66458 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-17a2c598-34aa-474c-80ec-92409bc66458 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-17a2c598-34aa-474c-80ec-92409bc66458 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-17a2c598-34aa-474c-80ec-92409bc66458 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-17a2c598-34aa-474c-80ec-92409bc66458 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-17a2c598-34aa-474c-80ec-92409bc66458 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-17a2c598-34aa-474c-80ec-92409bc66458 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:17 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-17a2c598-34aa-474c-80ec-92409bc66458 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855c585696694964974a8df948ab7899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac7fb012e144cdaa7da36ee9b590a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:47:17 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-17a2c598-34aa-474c-80ec-92409bc66458 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc" status: 200 len: 1537 microversion: 2.1 time: 0.274984 Apr 14 15:47:17 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 181/541] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:47:17 2023] GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc => generated 1537 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:47:18 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:47:18 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:18 user devstack@n-api.service[61874]: DEBUG nova.objects.instance [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'flavor' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=61874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:47:18 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/action" status: 200 len: 32 microversion: 2.1 time: 0.180047 Apr 14 15:47:18 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 180/542] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:47:18 2023] POST /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:47:18 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-db8c55e2-6847-49e7-8594-b6c4ef530b97 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:47:18 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-db8c55e2-6847-49e7-8594-b6c4ef530b97 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-db8c55e2-6847-49e7-8594-b6c4ef530b97 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-db8c55e2-6847-49e7-8594-b6c4ef530b97 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-db8c55e2-6847-49e7-8594-b6c4ef530b97 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-db8c55e2-6847-49e7-8594-b6c4ef530b97 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-db8c55e2-6847-49e7-8594-b6c4ef530b97 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-db8c55e2-6847-49e7-8594-b6c4ef530b97 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:19 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-db8c55e2-6847-49e7-8594-b6c4ef530b97 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:47:19 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-db8c55e2-6847-49e7-8594-b6c4ef530b97 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" status: 200 len: 1723 microversion: 2.1 time: 0.218280 Apr 14 15:47:19 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 182/543] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:47:18 2023] GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:47:19 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-923de20c-1e1f-4837-8bf5-6632c88a2628 req-90dee8c5-d065-420b-bbf8-c463372639c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "name": "network-vif-unplugged", "status": "completed", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:47:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-923de20c-1e1f-4837-8bf5-6632c88a2628 req-90dee8c5-d065-420b-bbf8-c463372639c7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-923de20c-1e1f-4837-8bf5-6632c88a2628 req-90dee8c5-d065-420b-bbf8-c463372639c7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-923de20c-1e1f-4837-8bf5-6632c88a2628 req-90dee8c5-d065-420b-bbf8-c463372639c7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:19 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-923de20c-1e1f-4837-8bf5-6632c88a2628 req-90dee8c5-d065-420b-bbf8-c463372639c7 service nova] Creating event network-vif-unplugged:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:47:19 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-923de20c-1e1f-4837-8bf5-6632c88a2628 req-90dee8c5-d065-420b-bbf8-c463372639c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100043 Apr 14 15:47:19 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 182/544] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:47:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:47:21 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-35559e76-53e0-4c7e-b625-5e72ab0fecc1 req-83bd82a5-615d-46d2-920f-a5eae22a16cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "name": "network-vif-plugged", "status": "completed", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:47:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-35559e76-53e0-4c7e-b625-5e72ab0fecc1 req-83bd82a5-615d-46d2-920f-a5eae22a16cb service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-35559e76-53e0-4c7e-b625-5e72ab0fecc1 req-83bd82a5-615d-46d2-920f-a5eae22a16cb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-35559e76-53e0-4c7e-b625-5e72ab0fecc1 req-83bd82a5-615d-46d2-920f-a5eae22a16cb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:21 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-35559e76-53e0-4c7e-b625-5e72ab0fecc1 req-83bd82a5-615d-46d2-920f-a5eae22a16cb service nova] Creating event network-vif-plugged:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:47:21 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-35559e76-53e0-4c7e-b625-5e72ab0fecc1 req-83bd82a5-615d-46d2-920f-a5eae22a16cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031200 Apr 14 15:47:21 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 181/545] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:47:23 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-952ca30f-e790-47d8-9294-c327780a3dbd tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:47:23 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-952ca30f-e790-47d8-9294-c327780a3dbd tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-952ca30f-e790-47d8-9294-c327780a3dbd tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-952ca30f-e790-47d8-9294-c327780a3dbd tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-952ca30f-e790-47d8-9294-c327780a3dbd tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-952ca30f-e790-47d8-9294-c327780a3dbd tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-952ca30f-e790-47d8-9294-c327780a3dbd tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-952ca30f-e790-47d8-9294-c327780a3dbd tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-952ca30f-e790-47d8-9294-c327780a3dbd tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] HTTP exception thrown: Instance d7088d6e-b443-4c76-8a13-199e0721ea36 could not be found. Apr 14 15:47:23 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-952ca30f-e790-47d8-9294-c327780a3dbd tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Request method failure captured: Apr 14 15:47:23 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36 HTTP/1.1 Apr 14 15:47:23 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:47:23 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:47:23 user devstack@n-api.service[61876]: Connection: close Apr 14 15:47:23 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:47:23 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:47:23 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:47:23 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:47:23 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXQfuRe5Mx84pROzOPxXeB-PImcZqKH5R_6m5AwP3qCwwe0KmwOb4TFi8y6SMuALTDcSTknRD1fri0QgjYfA6wpM3bXvPSZBB6hPCxoBzTLpQY2P1GzJ7jp7ivNmM-vc9faSmLpkqMW80qGNJRDohvFywVJlTvOwoteimMsLFvejs-M Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Project-Id: 6d21cbc9fcc74fdd8579bad00a8ba2eb Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Project-Name: tempest-TestMinimumBasicScenario-554859149 Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d21cbc9fcc74fdd8579bad00a8ba2eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d21cbc9fcc74fdd8579bad00a8ba2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d21cbc9fcc74fdd8579bad00a8ba2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Tenant: tempest-TestMinimumBasicScenario-554859149 Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Tenant-Id: 6d21cbc9fcc74fdd8579bad00a8ba2eb Apr 14 15:47:23 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-TestMinimumBasicScenario-554859149 Apr 14 15:47:23 user devstack@n-api.service[61876]: X-User: tempest-TestMinimumBasicScenario-554859149-project-member Apr 14 15:47:23 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:47:23 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:47:23 user devstack@n-api.service[61876]: X-User-Id: 4e5d615d61ea4b1dafa4207d7b21e2d5 Apr 14 15:47:23 user devstack@n-api.service[61876]: X-User-Name: tempest-TestMinimumBasicScenario-554859149-project-member Apr 14 15:47:23 user devstack@n-api.service[61876]: method: > Apr 14 15:47:23 user devstack@n-api.service[61876]: exception: Instance d7088d6e-b443-4c76-8a13-199e0721ea36 could not be found. Apr 14 15:47:23 user devstack@n-api.service[61876]: action_args: {'id': 'd7088d6e-b443-4c76-8a13-199e0721ea36'} Apr 14 15:47:23 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7088d6e-b443-4c76-8a13-199e0721ea36 could not be found. Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7088d6e-b443-4c76-8a13-199e0721ea36 could not be found. Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7088d6e-b443-4c76-8a13-199e0721ea36 could not be found. Apr 14 15:47:23 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:47:23 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-952ca30f-e790-47d8-9294-c327780a3dbd tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Returning 404 to user: Instance d7088d6e-b443-4c76-8a13-199e0721ea36 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:47:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-952ca30f-e790-47d8-9294-c327780a3dbd tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36" status: 404 len: 111 microversion: 2.1 time: 0.030953 Apr 14 15:47:23 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 183/546] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:47:23 2023] GET /compute/v2.1/servers/d7088d6e-b443-4c76-8a13-199e0721ea36 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:47:23 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-11f49491-56a9-47af-8f5a-0bfb37e971d8 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '.version_select at 0x7f2970b1f6d0>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:47:23 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-11f49491-56a9-47af-8f5a-0bfb37e971d8 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1176689891" status: 202 len: 0 microversion: 2.1 time: 0.030617 Apr 14 15:47:23 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 183/547] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 15:47:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1176689891 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:47:23 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "name": "network-vif-plugged", "status": "completed", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}, {"server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "name": "network-vif-plugged", "status": "completed", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:47:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:24 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] Creating event network-vif-plugged:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:47:24 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] Creating event network-vif-plugged:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:47:24 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029053 Apr 14 15:47:24 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 182/548] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:47:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:47:25 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-f6e09084-b105-4b5f-aac1-7870da281c07 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Action: 'create', calling method: .version_select at 0x7f2970941090>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1135265511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCI6sgJi6SCLfQjKyUtRCtzVQYpURZ2j5LDAaywthgR5+o0GaA3sllz7unMwlMKTrLcOnUHA7Jev2qQMA2hgyH8ueNx1T3M2tGGw3Y5dpWq/0AnTjCeBEu++cIHIIESng=="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:47:25 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-f6e09084-b105-4b5f-aac1-7870da281c07 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting quotas for project 6d21cbc9fcc74fdd8579bad00a8ba2eb. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:47:25 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-f6e09084-b105-4b5f-aac1-7870da281c07 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting quotas for user 4e5d615d61ea4b1dafa4207d7b21e2d5 and project 6d21cbc9fcc74fdd8579bad00a8ba2eb. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:47:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-f6e09084-b105-4b5f-aac1-7870da281c07 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045828 Apr 14 15:47:25 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 184/549] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 15:47:25 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:47:25 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1963605977", "imageRef": "60ef30a0-1876-4fd5-b5e6-0f713900a38d", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1135265511", "networks": [{"uuid": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4"}]}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:47:25 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] validate_networks() for [('ccc6a426-f548-4d9b-b4d1-89934ac80cf4', None, None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting quotas for project 6d21cbc9fcc74fdd8579bad00a8ba2eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting quotas for user 4e5d615d61ea4b1dafa4207d7b21e2d5 and project 6d21cbc9fcc74fdd8579bad00a8ba2eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:47:26 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60ef30a0-1876-4fd5-b5e6-0f713900a38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:47:26 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.623086 Apr 14 15:47:26 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 184/550] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:47:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:47:26 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-1e9a752d-0f51-473e-a184-fda2f7ced3bc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:47:26 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-1e9a752d-0f51-473e-a184-fda2f7ced3bc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:26 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-1e9a752d-0f51-473e-a184-fda2f7ced3bc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:47:26 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-1e9a752d-0f51-473e-a184-fda2f7ced3bc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4" status: 200 len: 1253 microversion: 2.1 time: 0.073287 Apr 14 15:47:26 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 183/551] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:47:26 2023] GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4 => generated 1253 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:47:29 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:47:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:29 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] Creating event network-changed:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:47:29 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126530 Apr 14 15:47:29 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 185/552] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:47:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:47:29 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-beed93b2-ce74-49f5-a1f9-48af4382f193 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:47:29 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-beed93b2-ce74-49f5-a1f9-48af4382f193 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-beed93b2-ce74-49f5-a1f9-48af4382f193 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-beed93b2-ce74-49f5-a1f9-48af4382f193 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-beed93b2-ce74-49f5-a1f9-48af4382f193 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-beed93b2-ce74-49f5-a1f9-48af4382f193 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-beed93b2-ce74-49f5-a1f9-48af4382f193 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-beed93b2-ce74-49f5-a1f9-48af4382f193 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:29 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-beed93b2-ce74-49f5-a1f9-48af4382f193 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054023 Apr 14 15:47:29 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 185/553] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:47:29 2023] GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:47:31 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-b83cd31f-cd0a-49e2-8eb2-95111996b15b req-88487e1d-0d7d-4a31-bbbb-4cd5c4e8f8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "name": "network-vif-plugged", "status": "completed", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:47:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b83cd31f-cd0a-49e2-8eb2-95111996b15b req-88487e1d-0d7d-4a31-bbbb-4cd5c4e8f8f8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b83cd31f-cd0a-49e2-8eb2-95111996b15b req-88487e1d-0d7d-4a31-bbbb-4cd5c4e8f8f8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b83cd31f-cd0a-49e2-8eb2-95111996b15b req-88487e1d-0d7d-4a31-bbbb-4cd5c4e8f8f8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:31 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-b83cd31f-cd0a-49e2-8eb2-95111996b15b req-88487e1d-0d7d-4a31-bbbb-4cd5c4e8f8f8 service nova] Creating event network-vif-plugged:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:47:31 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-b83cd31f-cd0a-49e2-8eb2-95111996b15b req-88487e1d-0d7d-4a31-bbbb-4cd5c4e8f8f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054393 Apr 14 15:47:31 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 184/554] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:47:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:47:33 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8afd5e2-ef3f-4729-9701-20b41b3c93a7"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:47:33 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:33 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-4cd63a79-b8ca-4900-9dda-e10a4ee0c1ce req-186ec5ce-240b-4cd2-a018-b8cf09860cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "name": "network-vif-plugged", "status": "completed", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:47:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-4cd63a79-b8ca-4900-9dda-e10a4ee0c1ce req-186ec5ce-240b-4cd2-a018-b8cf09860cb9 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-4cd63a79-b8ca-4900-9dda-e10a4ee0c1ce req-186ec5ce-240b-4cd2-a018-b8cf09860cb9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-4cd63a79-b8ca-4900-9dda-e10a4ee0c1ce req-186ec5ce-240b-4cd2-a018-b8cf09860cb9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:33 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-4cd63a79-b8ca-4900-9dda-e10a4ee0c1ce req-186ec5ce-240b-4cd2-a018-b8cf09860cb9 service nova] Creating event network-vif-plugged:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:47:33 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-4cd63a79-b8ca-4900-9dda-e10a4ee0c1ce req-186ec5ce-240b-4cd2-a018-b8cf09860cb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033447 Apr 14 15:47:33 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 186/555] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:47:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:47:33 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301207 Apr 14 15:47:33 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 186/556] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:47:33 2023] POST /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:47:40 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:40 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:47:40 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:40 user devstack@n-api.service[61874]: DEBUG nova.objects.instance [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'services' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=61874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:47:40 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-volume_attachments/8b38580d-ee34-4663-a8dd-8f2e35ffc774" status: 202 len: 0 microversion: 2.1 time: 0.247568 Apr 14 15:47:40 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 185/557] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:47:40 2023] DELETE /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-volume_attachments/8b38580d-ee34-4663-a8dd-8f2e35ffc774 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:47:40 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-8aebdca7-bdeb-4ed4-9712-3b19997c61f5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:47:40 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-8aebdca7-bdeb-4ed4-9712-3b19997c61f5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:40 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:40 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8aebdca7-bdeb-4ed4-9712-3b19997c61f5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8aebdca7-bdeb-4ed4-9712-3b19997c61f5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8aebdca7-bdeb-4ed4-9712-3b19997c61f5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8aebdca7-bdeb-4ed4-9712-3b19997c61f5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8aebdca7-bdeb-4ed4-9712-3b19997c61f5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8aebdca7-bdeb-4ed4-9712-3b19997c61f5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-8aebdca7-bdeb-4ed4-9712-3b19997c61f5 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048849 Apr 14 15:47:40 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 187/558] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:47:40 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:47:41 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:41 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:47:41 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:41 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:41 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:41 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'services' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:47:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments/a8afd5e2-ef3f-4729-9701-20b41b3c93a7" status: 202 len: 0 microversion: 2.1 time: 0.165304 Apr 14 15:47:41 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 187/559] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:47:41 2023] DELETE /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments/a8afd5e2-ef3f-4729-9701-20b41b3c93a7 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:47:41 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-c9d49b1c-fc63-417a-8de9-2e148b46a6dd tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:47:41 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-c9d49b1c-fc63-417a-8de9-2e148b46a6dd tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:41 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=17 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c9d49b1c-fc63-417a-8de9-2e148b46a6dd tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c9d49b1c-fc63-417a-8de9-2e148b46a6dd tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c9d49b1c-fc63-417a-8de9-2e148b46a6dd tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c9d49b1c-fc63-417a-8de9-2e148b46a6dd tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c9d49b1c-fc63-417a-8de9-2e148b46a6dd tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c9d49b1c-fc63-417a-8de9-2e148b46a6dd tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:41 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:42 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-c9d49b1c-fc63-417a-8de9-2e148b46a6dd tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049036 Apr 14 15:47:42 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 186/560] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:47:41 2023] GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:47:51 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:51 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=26 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:51 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-2012166712"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:47:51 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:51 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583/action" status: 202 len: 52 microversion: 2.87 time: 0.947189 Apr 14 15:47:51 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 188/561] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 15:47:51 2023] POST /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583/action => generated 52 bytes in 949 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 15:47:57 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:57 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:47:57 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6879796c-0aa0-4840-8ebc-6f7be537e53a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:47:57 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-6879796c-0aa0-4840-8ebc-6f7be537e53a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:47:57 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6879796c-0aa0-4840-8ebc-6f7be537e53a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:57 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6879796c-0aa0-4840-8ebc-6f7be537e53a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:57 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6879796c-0aa0-4840-8ebc-6f7be537e53a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:57 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6879796c-0aa0-4840-8ebc-6f7be537e53a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:47:57 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6879796c-0aa0-4840-8ebc-6f7be537e53a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:47:57 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6879796c-0aa0-4840-8ebc-6f7be537e53a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:47:57 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-6879796c-0aa0-4840-8ebc-6f7be537e53a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:47:57 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-6879796c-0aa0-4840-8ebc-6f7be537e53a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:47:57 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-6879796c-0aa0-4840-8ebc-6f7be537e53a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:47:57 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6879796c-0aa0-4840-8ebc-6f7be537e53a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583" status: 200 len: 1691 microversion: 2.87 time: 0.240869 Apr 14 15:47:57 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 188/562] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:47:57 2023] GET /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583 => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:48:09 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:09 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=5 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:09 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4c2131da-6a7e-4baf-a3a8-cc191dafaec2 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:09 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-4c2131da-6a7e-4baf-a3a8-cc191dafaec2 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4c2131da-6a7e-4baf-a3a8-cc191dafaec2 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4c2131da-6a7e-4baf-a3a8-cc191dafaec2 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4c2131da-6a7e-4baf-a3a8-cc191dafaec2 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4c2131da-6a7e-4baf-a3a8-cc191dafaec2 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4c2131da-6a7e-4baf-a3a8-cc191dafaec2 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4c2131da-6a7e-4baf-a3a8-cc191dafaec2 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:09 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-4c2131da-6a7e-4baf-a3a8-cc191dafaec2 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:48:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-4c2131da-6a7e-4baf-a3a8-cc191dafaec2 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" status: 200 len: 1703 microversion: 2.1 time: 0.338823 Apr 14 15:48:09 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 187/563] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:48:09 2023] GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => generated 1703 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:48:16 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:16 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3262e29d-0f37-4db1-b047-ca13a8ed6155 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:16 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-3262e29d-0f37-4db1-b047-ca13a8ed6155 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3262e29d-0f37-4db1-b047-ca13a8ed6155 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3262e29d-0f37-4db1-b047-ca13a8ed6155 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3262e29d-0f37-4db1-b047-ca13a8ed6155 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3262e29d-0f37-4db1-b047-ca13a8ed6155 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3262e29d-0f37-4db1-b047-ca13a8ed6155 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3262e29d-0f37-4db1-b047-ca13a8ed6155 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-567c9288-318b-49cf-aabd-0f93dba45ef7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:16 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-567c9288-318b-49cf-aabd-0f93dba45ef7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-567c9288-318b-49cf-aabd-0f93dba45ef7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-567c9288-318b-49cf-aabd-0f93dba45ef7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-567c9288-318b-49cf-aabd-0f93dba45ef7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-567c9288-318b-49cf-aabd-0f93dba45ef7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-567c9288-318b-49cf-aabd-0f93dba45ef7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-567c9288-318b-49cf-aabd-0f93dba45ef7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:16 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-567c9288-318b-49cf-aabd-0f93dba45ef7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.195492 Apr 14 15:48:16 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 189/564] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 15:48:16 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/os-interface => generated 282 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:48:17 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-3262e29d-0f37-4db1-b047-ca13a8ed6155 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:48:17 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-3262e29d-0f37-4db1-b047-ca13a8ed6155 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4" status: 200 len: 1537 microversion: 2.1 time: 0.331742 Apr 14 15:48:17 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 189/565] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:48:16 2023] GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4 => generated 1537 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:48:17 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-e4c042b2-d891-4ba4-8740-9b9b34b1fbf0 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:17 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-e4c042b2-d891-4ba4-8740-9b9b34b1fbf0 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e4c042b2-d891-4ba4-8740-9b9b34b1fbf0 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e4c042b2-d891-4ba4-8740-9b9b34b1fbf0 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e4c042b2-d891-4ba4-8740-9b9b34b1fbf0 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e4c042b2-d891-4ba4-8740-9b9b34b1fbf0 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e4c042b2-d891-4ba4-8740-9b9b34b1fbf0 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e4c042b2-d891-4ba4-8740-9b9b34b1fbf0 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:17 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-e4c042b2-d891-4ba4-8740-9b9b34b1fbf0 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855c585696694964974a8df948ab7899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac7fb012e144cdaa7da36ee9b590a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:48:17 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-e4c042b2-d891-4ba4-8740-9b9b34b1fbf0 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc" status: 200 len: 1537 microversion: 2.1 time: 0.502297 Apr 14 15:48:17 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 188/566] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:48:17 2023] GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc => generated 1537 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:48:17 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:48:17 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-06e25d19-5385-43a5-8e60-e9bf0165c8b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:17 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-06e25d19-5385-43a5-8e60-e9bf0165c8b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-06e25d19-5385-43a5-8e60-e9bf0165c8b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-06e25d19-5385-43a5-8e60-e9bf0165c8b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-06e25d19-5385-43a5-8e60-e9bf0165c8b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-06e25d19-5385-43a5-8e60-e9bf0165c8b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-06e25d19-5385-43a5-8e60-e9bf0165c8b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-06e25d19-5385-43a5-8e60-e9bf0165c8b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:17 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] Creating event network-changed:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:48:17 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091616 Apr 14 15:48:17 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 190/567] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:48:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:48:17 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-06e25d19-5385-43a5-8e60-e9bf0165c8b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/ips" status: 200 len: 103 microversion: 2.1 time: 0.044938 Apr 14 15:48:17 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 190/568] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 15:48:17 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/ips => generated 103 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:48:20 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af42177f-7597-4b26-8c8b-27f37a044cfc", "tag": "e2569358-6e39-46e0-a34b-6f67930a0295"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:48:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] Creating event network-changed:e2569358-6e39-46e0-a34b-6f67930a0295 for instance af42177f-7597-4b26-8c8b-27f37a044cfc on user Apr 14 15:48:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032589 Apr 14 15:48:20 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 189/569] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:48:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:48:20 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5e3bd50-3e1a-473e-aef2-013490f04521"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:48:20 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:20 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "POST /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332824 Apr 14 15:48:20 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 191/570] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:48:20 2023] POST /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:48:20 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4daa4e7f-db2c-483e-b08d-d0fef5d74897"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:48:20 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:20 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312606 Apr 14 15:48:20 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 191/571] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:48:20 2023] POST /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:48:28 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:28 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:28 user devstack@n-api.service[61874]: DEBUG nova.objects.instance [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'services' on Instance uuid af42177f-7597-4b26-8c8b-27f37a044cfc {{(pid=61874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:48:28 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc/os-volume_attachments/a5e3bd50-3e1a-473e-aef2-013490f04521" status: 202 len: 0 microversion: 2.1 time: 0.176932 Apr 14 15:48:28 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 190/572] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:48:28 2023] DELETE /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc/os-volume_attachments/a5e3bd50-3e1a-473e-aef2-013490f04521 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:48:29 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-631df781-929c-40b4-b76d-56d2dbbc055f tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:29 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-631df781-929c-40b4-b76d-56d2dbbc055f tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-631df781-929c-40b4-b76d-56d2dbbc055f tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-631df781-929c-40b4-b76d-56d2dbbc055f tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-631df781-929c-40b4-b76d-56d2dbbc055f tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-631df781-929c-40b4-b76d-56d2dbbc055f tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-631df781-929c-40b4-b76d-56d2dbbc055f tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-631df781-929c-40b4-b76d-56d2dbbc055f tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:29 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-631df781-929c-40b4-b76d-56d2dbbc055f tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Apr 14 15:48:29 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 192/573] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:48:29 2023] GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:48:29 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-745a9380-d0a4-4b04-aef3-6088f6525cfe tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:48:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-745a9380-d0a4-4b04-aef3-6088f6525cfe tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-745a9380-d0a4-4b04-aef3-6088f6525cfe tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-745a9380-d0a4-4b04-aef3-6088f6525cfe tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:29 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-745a9380-d0a4-4b04-aef3-6088f6525cfe tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Going to try to stop instance {{(pid=61875) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 15:48:29 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-745a9380-d0a4-4b04-aef3-6088f6525cfe tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/action" status: 202 len: 0 microversion: 2.1 time: 0.116015 Apr 14 15:48:29 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 192/574] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:48:29 2023] POST /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:48:29 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-eb4ca722-0583-4610-b708-b7c49a8358c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:29 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-eb4ca722-0583-4610-b708-b7c49a8358c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:29 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-eb4ca722-0583-4610-b708-b7c49a8358c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:29 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-eb4ca722-0583-4610-b708-b7c49a8358c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:29 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-eb4ca722-0583-4610-b708-b7c49a8358c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:29 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-eb4ca722-0583-4610-b708-b7c49a8358c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:29 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-eb4ca722-0583-4610-b708-b7c49a8358c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:29 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-eb4ca722-0583-4610-b708-b7c49a8358c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:29 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-eb4ca722-0583-4610-b708-b7c49a8358c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:48:29 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-eb4ca722-0583-4610-b708-b7c49a8358c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 200 len: 1709 microversion: 2.1 time: 0.342507 Apr 14 15:48:29 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 191/575] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:48:29 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 1709 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:48:29 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-cc79daeb-de97-4ad0-abe4-965d3961682e req-cb59678b-617f-4e82-afa2-7f58fa1ae9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-unplugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:48:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-cc79daeb-de97-4ad0-abe4-965d3961682e req-cb59678b-617f-4e82-afa2-7f58fa1ae9dd service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-cc79daeb-de97-4ad0-abe4-965d3961682e req-cb59678b-617f-4e82-afa2-7f58fa1ae9dd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-cc79daeb-de97-4ad0-abe4-965d3961682e req-cb59678b-617f-4e82-afa2-7f58fa1ae9dd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:29 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-cc79daeb-de97-4ad0-abe4-965d3961682e req-cb59678b-617f-4e82-afa2-7f58fa1ae9dd service nova] Creating event network-vif-unplugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:48:29 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-cc79daeb-de97-4ad0-abe4-965d3961682e req-cb59678b-617f-4e82-afa2-7f58fa1ae9dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029106 Apr 14 15:48:29 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 193/576] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:48:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:48:30 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a582076e-f10e-46e8-aef8-0663c2289d12 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:30 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a582076e-f10e-46e8-aef8-0663c2289d12 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a582076e-f10e-46e8-aef8-0663c2289d12 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a582076e-f10e-46e8-aef8-0663c2289d12 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a582076e-f10e-46e8-aef8-0663c2289d12 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a582076e-f10e-46e8-aef8-0663c2289d12 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a582076e-f10e-46e8-aef8-0663c2289d12 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a582076e-f10e-46e8-aef8-0663c2289d12 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:30 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a582076e-f10e-46e8-aef8-0663c2289d12 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047522 Apr 14 15:48:30 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 193/577] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:48:30 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:48:30 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-7c68caf6-ba9c-41f4-9bf8-04dd2b32d655 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:30 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-7c68caf6-ba9c-41f4-9bf8-04dd2b32d655 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7c68caf6-ba9c-41f4-9bf8-04dd2b32d655 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7c68caf6-ba9c-41f4-9bf8-04dd2b32d655 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7c68caf6-ba9c-41f4-9bf8-04dd2b32d655 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7c68caf6-ba9c-41f4-9bf8-04dd2b32d655 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7c68caf6-ba9c-41f4-9bf8-04dd2b32d655 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7c68caf6-ba9c-41f4-9bf8-04dd2b32d655 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:30 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-7c68caf6-ba9c-41f4-9bf8-04dd2b32d655 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:48:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-7c68caf6-ba9c-41f4-9bf8-04dd2b32d655 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1676 microversion: 2.1 time: 0.217846 Apr 14 15:48:30 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 192/578] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:48:30 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:48:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-1e8d4171-55fd-412c-9472-62b69507d423 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:31 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-1e8d4171-55fd-412c-9472-62b69507d423 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1e8d4171-55fd-412c-9472-62b69507d423 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1e8d4171-55fd-412c-9472-62b69507d423 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1e8d4171-55fd-412c-9472-62b69507d423 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1e8d4171-55fd-412c-9472-62b69507d423 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1e8d4171-55fd-412c-9472-62b69507d423 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1e8d4171-55fd-412c-9472-62b69507d423 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:31 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-1e8d4171-55fd-412c-9472-62b69507d423 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:48:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-1e8d4171-55fd-412c-9472-62b69507d423 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1676 microversion: 2.1 time: 0.213624 Apr 14 15:48:31 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 194/579] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:48:30 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:48:31 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-89c2cb56-dec0-4726-820c-dc1c22177160 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:31 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-89c2cb56-dec0-4726-820c-dc1c22177160 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-89c2cb56-dec0-4726-820c-dc1c22177160 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-89c2cb56-dec0-4726-820c-dc1c22177160 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-89c2cb56-dec0-4726-820c-dc1c22177160 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-89c2cb56-dec0-4726-820c-dc1c22177160 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-89c2cb56-dec0-4726-820c-dc1c22177160 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-89c2cb56-dec0-4726-820c-dc1c22177160 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:31 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-89c2cb56-dec0-4726-820c-dc1c22177160 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:48:31 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-89c2cb56-dec0-4726-820c-dc1c22177160 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1676 microversion: 2.1 time: 0.141345 Apr 14 15:48:31 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 194/580] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:48:31 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1676 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:48:31 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-1e8505c6-3b8d-4aad-ae02-c6974134cfe3 req-bc521390-6994-4006-be42-a7a70f2f139b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-plugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:48:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1e8505c6-3b8d-4aad-ae02-c6974134cfe3 req-bc521390-6994-4006-be42-a7a70f2f139b service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1e8505c6-3b8d-4aad-ae02-c6974134cfe3 req-bc521390-6994-4006-be42-a7a70f2f139b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1e8505c6-3b8d-4aad-ae02-c6974134cfe3 req-bc521390-6994-4006-be42-a7a70f2f139b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:32 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-1e8505c6-3b8d-4aad-ae02-c6974134cfe3 req-bc521390-6994-4006-be42-a7a70f2f139b service nova] Creating event network-vif-plugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:48:32 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-1e8505c6-3b8d-4aad-ae02-c6974134cfe3 req-bc521390-6994-4006-be42-a7a70f2f139b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028160 Apr 14 15:48:32 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 193/581] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:48:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:48:32 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-263bac3b-bf32-447d-a0d6-126051904d81 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:32 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-263bac3b-bf32-447d-a0d6-126051904d81 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-263bac3b-bf32-447d-a0d6-126051904d81 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-263bac3b-bf32-447d-a0d6-126051904d81 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-263bac3b-bf32-447d-a0d6-126051904d81 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-263bac3b-bf32-447d-a0d6-126051904d81 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-263bac3b-bf32-447d-a0d6-126051904d81 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-263bac3b-bf32-447d-a0d6-126051904d81 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:32 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-263bac3b-bf32-447d-a0d6-126051904d81 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.139565 Apr 14 15:48:32 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 195/582] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:48:32 2023] GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:48:36 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb908beb-7d3a-4fcc-9e37-d2fa96844028"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:48:36 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318124 Apr 14 15:48:36 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 195/583] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:48:36 2023] POST /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:48:44 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=14 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:44 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:44 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:44 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:44 user devstack@n-api.service[61874]: DEBUG nova.objects.instance [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'services' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=61874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:48:44 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments/bb908beb-7d3a-4fcc-9e37-d2fa96844028" status: 202 len: 0 microversion: 2.1 time: 0.188626 Apr 14 15:48:44 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 194/584] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:48:44 2023] DELETE /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments/bb908beb-7d3a-4fcc-9e37-d2fa96844028 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:48:44 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-dec9739a-2fbc-43ab-9f8e-bc0cdc50f85b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:44 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-dec9739a-2fbc-43ab-9f8e-bc0cdc50f85b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:44 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=14 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:44 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-dec9739a-2fbc-43ab-9f8e-bc0cdc50f85b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-dec9739a-2fbc-43ab-9f8e-bc0cdc50f85b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-dec9739a-2fbc-43ab-9f8e-bc0cdc50f85b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-dec9739a-2fbc-43ab-9f8e-bc0cdc50f85b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-dec9739a-2fbc-43ab-9f8e-bc0cdc50f85b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-dec9739a-2fbc-43ab-9f8e-bc0cdc50f85b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:44 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-dec9739a-2fbc-43ab-9f8e-bc0cdc50f85b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053690 Apr 14 15:48:44 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 196/585] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:48:44 2023] GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:48:57 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=14 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:57 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2100453200", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "destination_type": "volume"}], "networks": [{"uuid": "7c17386f-ee51-4b70-936e-ca90f2fb5615"}]}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:48:57 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] validate_networks() for [('7c17386f-ee51-4b70-936e-ca90f2fb5615', None, None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting quotas for project 584a53650c014f87b9622f2011996200. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting quotas for user efb645d110464e7e85d7c955ee9f3466 and project 584a53650c014f87b9622f2011996200. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:48:58 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:48:58 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.649190 Apr 14 15:48:58 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 196/586] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 15:48:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 15:48:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:48:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-d537b259-b729-4898-9186-7f271d43124b tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:48:58 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-d537b259-b729-4898-9186-7f271d43124b tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:48:58 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-d537b259-b729-4898-9186-7f271d43124b tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:48:58 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-d537b259-b729-4898-9186-7f271d43124b tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:48:58 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-d537b259-b729-4898-9186-7f271d43124b tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:48:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-d537b259-b729-4898-9186-7f271d43124b tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb" status: 200 len: 1395 microversion: 2.87 time: 0.080757 Apr 14 15:48:58 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 195/587] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:48:58 2023] GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb => generated 1395 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:49:01 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:01 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:01 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] Creating event network-changed:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:49:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044640 Apr 14 15:49:01 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 197/588] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-d8af1f33-78e9-4e60-b752-d3dc0aa9f23b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d8af1f33-78e9-4e60-b752-d3dc0aa9f23b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d8af1f33-78e9-4e60-b752-d3dc0aa9f23b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d8af1f33-78e9-4e60-b752-d3dc0aa9f23b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d8af1f33-78e9-4e60-b752-d3dc0aa9f23b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d8af1f33-78e9-4e60-b752-d3dc0aa9f23b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d8af1f33-78e9-4e60-b752-d3dc0aa9f23b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d8af1f33-78e9-4e60-b752-d3dc0aa9f23b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-d8af1f33-78e9-4e60-b752-d3dc0aa9f23b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] HTTP exception thrown: Cannot 'detach_volume' instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 while it is in vm_state rescued Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-d8af1f33-78e9-4e60-b752-d3dc0aa9f23b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Request method failure captured: Apr 14 15:49:09 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-volume_attachments/11765086-22f8-49da-9ddf-855ca5edd6c5 HTTP/1.1 Apr 14 15:49:09 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:49:09 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:49:09 user devstack@n-api.service[61875]: Connection: close Apr 14 15:49:09 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:49:09 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:49:09 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:49:09 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:49:09 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXMKxzbBhP_wAtg_GdyJNNrWMR04NHs8zgKICtljO-nO6YTCpgo2vyufA6TA9obkNQP1BDx8dqjHFzo_6wx95XvZIjeEaJUUrM_1TVkjKaYmi4C7vK-xA49gMl_SHFlLmsp5h9mS72_mB06A8lcnKv1B72X0XrCUIHCQChJFUCLD5SA Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Project-Id: 609ac7b149e14baab270d83a2646fbdf Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Tenant-Id: 609ac7b149e14baab270d83a2646fbdf Apr 14 15:49:09 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:49:09 user devstack@n-api.service[61875]: X-User: tempest-ServerRescueNegativeTestJSON-1174024196-project-member Apr 14 15:49:09 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:49:09 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:49:09 user devstack@n-api.service[61875]: X-User-Id: 3fa924fefda1428d81152fd573540f26 Apr 14 15:49:09 user devstack@n-api.service[61875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1174024196-project-member Apr 14 15:49:09 user devstack@n-api.service[61875]: method: > Apr 14 15:49:09 user devstack@n-api.service[61875]: exception: Cannot 'detach_volume' instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 while it is in vm_state rescued Apr 14 15:49:09 user devstack@n-api.service[61875]: action_args: {'server_id': 'f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72', 'id': '11765086-22f8-49da-9ddf-855ca5edd6c5'} Apr 14 15:49:09 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 while it is in vm_state rescued Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 while it is in vm_state rescued Apr 14 15:49:09 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:49:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-d8af1f33-78e9-4e60-b752-d3dc0aa9f23b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Returning 409 to user: Cannot 'detach_volume' instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 while it is in vm_state rescued {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:49:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-d8af1f33-78e9-4e60-b752-d3dc0aa9f23b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-volume_attachments/11765086-22f8-49da-9ddf-855ca5edd6c5" status: 409 len: 152 microversion: 2.1 time: 0.113016 Apr 14 15:49:09 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 197/589] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:49:09 2023] DELETE /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-volume_attachments/11765086-22f8-49da-9ddf-855ca5edd6c5 => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 15:49:09 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:09 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:09 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:09 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/action" status: 202 len: 0 microversion: 2.1 time: 0.077948 Apr 14 15:49:09 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 196/590] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:49:09 2023] POST /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:49:09 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5b0afea1-0814-44f6-8f3c-d47526ba6045 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:09 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-5b0afea1-0814-44f6-8f3c-d47526ba6045 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b0afea1-0814-44f6-8f3c-d47526ba6045 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b0afea1-0814-44f6-8f3c-d47526ba6045 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b0afea1-0814-44f6-8f3c-d47526ba6045 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b0afea1-0814-44f6-8f3c-d47526ba6045 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b0afea1-0814-44f6-8f3c-d47526ba6045 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b0afea1-0814-44f6-8f3c-d47526ba6045 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:10 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-5b0afea1-0814-44f6-8f3c-d47526ba6045 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5b0afea1-0814-44f6-8f3c-d47526ba6045 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" status: 200 len: 1711 microversion: 2.1 time: 0.260271 Apr 14 15:49:10 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 198/591] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:49:09 2023] GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => generated 1711 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:49:11 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-58189523-eceb-4a17-8f39-2df065c6aaa3 req-bb2cc737-60cf-4478-a2ff-3ab848042f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "name": "network-vif-unplugged", "status": "completed", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-58189523-eceb-4a17-8f39-2df065c6aaa3 req-bb2cc737-60cf-4478-a2ff-3ab848042f01 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-58189523-eceb-4a17-8f39-2df065c6aaa3 req-bb2cc737-60cf-4478-a2ff-3ab848042f01 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-58189523-eceb-4a17-8f39-2df065c6aaa3 req-bb2cc737-60cf-4478-a2ff-3ab848042f01 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:11 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-58189523-eceb-4a17-8f39-2df065c6aaa3 req-bb2cc737-60cf-4478-a2ff-3ab848042f01 service nova] Creating event network-vif-unplugged:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:49:11 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-58189523-eceb-4a17-8f39-2df065c6aaa3 req-bb2cc737-60cf-4478-a2ff-3ab848042f01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045120 Apr 14 15:49:11 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 198/592] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:13 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-af37aaa8-30d2-44e8-9b01-d98acdc2c02d req-3c27671d-d56c-4298-9af1-5d018c62f332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "name": "network-vif-plugged", "status": "completed", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-af37aaa8-30d2-44e8-9b01-d98acdc2c02d req-3c27671d-d56c-4298-9af1-5d018c62f332 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-af37aaa8-30d2-44e8-9b01-d98acdc2c02d req-3c27671d-d56c-4298-9af1-5d018c62f332 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-af37aaa8-30d2-44e8-9b01-d98acdc2c02d req-3c27671d-d56c-4298-9af1-5d018c62f332 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:13 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-af37aaa8-30d2-44e8-9b01-d98acdc2c02d req-3c27671d-d56c-4298-9af1-5d018c62f332 service nova] Creating event network-vif-plugged:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:49:13 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-af37aaa8-30d2-44e8-9b01-d98acdc2c02d req-3c27671d-d56c-4298-9af1-5d018c62f332 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031158 Apr 14 15:49:13 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 197/593] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:14 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-c8c73feb-77e6-45b2-b988-352fb42e2c81 req-f7e86f99-624d-43a3-8507-05c49c4aaf83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-plugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c8c73feb-77e6-45b2-b988-352fb42e2c81 req-f7e86f99-624d-43a3-8507-05c49c4aaf83 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c8c73feb-77e6-45b2-b988-352fb42e2c81 req-f7e86f99-624d-43a3-8507-05c49c4aaf83 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c8c73feb-77e6-45b2-b988-352fb42e2c81 req-f7e86f99-624d-43a3-8507-05c49c4aaf83 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:14 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-c8c73feb-77e6-45b2-b988-352fb42e2c81 req-f7e86f99-624d-43a3-8507-05c49c4aaf83 service nova] Creating event network-vif-plugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:49:14 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-c8c73feb-77e6-45b2-b988-352fb42e2c81 req-f7e86f99-624d-43a3-8507-05c49c4aaf83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039523 Apr 14 15:49:14 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 199/594] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:15 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "name": "network-vif-plugged", "status": "completed", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}, {"server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "name": "network-vif-plugged", "status": "completed", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:15 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] Creating event network-vif-plugged:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:49:15 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] Creating event network-vif-plugged:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:49:15 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041336 Apr 14 15:49:15 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 199/595] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-dfd571aa-1daa-4bfb-b41d-7a2857af97f2 req-15409fd3-aaa4-426e-b936-a4d3a9065608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-plugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-dfd571aa-1daa-4bfb-b41d-7a2857af97f2 req-15409fd3-aaa4-426e-b936-a4d3a9065608 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-dfd571aa-1daa-4bfb-b41d-7a2857af97f2 req-15409fd3-aaa4-426e-b936-a4d3a9065608 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-dfd571aa-1daa-4bfb-b41d-7a2857af97f2 req-15409fd3-aaa4-426e-b936-a4d3a9065608 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:16 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-dfd571aa-1daa-4bfb-b41d-7a2857af97f2 req-15409fd3-aaa4-426e-b936-a4d3a9065608 service nova] Creating event network-vif-plugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:49:16 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-dfd571aa-1daa-4bfb-b41d-7a2857af97f2 req-15409fd3-aaa4-426e-b936-a4d3a9065608 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034255 Apr 14 15:49:16 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 198/596] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:17 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5ff3ccff-d95b-4d01-9cea-1eda0e11fc97 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:17 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-5ff3ccff-d95b-4d01-9cea-1eda0e11fc97 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5ff3ccff-d95b-4d01-9cea-1eda0e11fc97 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5ff3ccff-d95b-4d01-9cea-1eda0e11fc97 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5ff3ccff-d95b-4d01-9cea-1eda0e11fc97 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5ff3ccff-d95b-4d01-9cea-1eda0e11fc97 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5ff3ccff-d95b-4d01-9cea-1eda0e11fc97 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5ff3ccff-d95b-4d01-9cea-1eda0e11fc97 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:17 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-5ff3ccff-d95b-4d01-9cea-1eda0e11fc97 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:17 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5ff3ccff-d95b-4d01-9cea-1eda0e11fc97 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4" status: 200 len: 1537 microversion: 2.1 time: 0.238937 Apr 14 15:49:17 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 200/597] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:49:17 2023] GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4 => generated 1537 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:49:17 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-9f46cd0a-3fc5-4656-8bc1-caeb09c41083 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:17 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-9f46cd0a-3fc5-4656-8bc1-caeb09c41083 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:17 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-9f46cd0a-3fc5-4656-8bc1-caeb09c41083 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Searching by: {'deleted': False, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb'} {{(pid=61875) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 15:49:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9f46cd0a-3fc5-4656-8bc1-caeb09c41083 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9f46cd0a-3fc5-4656-8bc1-caeb09c41083 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9f46cd0a-3fc5-4656-8bc1-caeb09c41083 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9f46cd0a-3fc5-4656-8bc1-caeb09c41083 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9f46cd0a-3fc5-4656-8bc1-caeb09c41083 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9f46cd0a-3fc5-4656-8bc1-caeb09c41083 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:17 user devstack@n-api.service[61875]: DEBUG nova.compute.multi_cell_list [None req-9f46cd0a-3fc5-4656-8bc1-caeb09c41083 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 15:49:17 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-9f46cd0a-3fc5-4656-8bc1-caeb09c41083 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.078490 Apr 14 15:49:17 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 200/598] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 15:49:17 2023] GET /compute/v2.1/servers => generated 341 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:17 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-36deb3c8-1f4c-40e4-981f-57ecccf194d8 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:17 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-36deb3c8-1f4c-40e4-981f-57ecccf194d8 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-36deb3c8-1f4c-40e4-981f-57ecccf194d8 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-36deb3c8-1f4c-40e4-981f-57ecccf194d8 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-36deb3c8-1f4c-40e4-981f-57ecccf194d8 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-36deb3c8-1f4c-40e4-981f-57ecccf194d8 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-36deb3c8-1f4c-40e4-981f-57ecccf194d8 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-36deb3c8-1f4c-40e4-981f-57ecccf194d8 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:17 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-36deb3c8-1f4c-40e4-981f-57ecccf194d8 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:17 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-36deb3c8-1f4c-40e4-981f-57ecccf194d8 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4" status: 200 len: 1537 microversion: 2.1 time: 0.273593 Apr 14 15:49:17 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 199/599] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:49:17 2023] GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4 => generated 1537 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:49:19 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-3862b57a-b108-46aa-adca-1d03d7dc51d7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:19 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-3862b57a-b108-46aa-adca-1d03d7dc51d7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3862b57a-b108-46aa-adca-1d03d7dc51d7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3862b57a-b108-46aa-adca-1d03d7dc51d7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3862b57a-b108-46aa-adca-1d03d7dc51d7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3862b57a-b108-46aa-adca-1d03d7dc51d7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3862b57a-b108-46aa-adca-1d03d7dc51d7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3862b57a-b108-46aa-adca-1d03d7dc51d7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:19 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-3862b57a-b108-46aa-adca-1d03d7dc51d7 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068354 Apr 14 15:49:19 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 201/600] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:49:19 2023] GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:49:19 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af42177f-7597-4b26-8c8b-27f37a044cfc", "tag": "e2569358-6e39-46e0-a34b-6f67930a0295"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:19 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:19 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:19 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] Creating event network-changed:e2569358-6e39-46e0-a34b-6f67930a0295 for instance af42177f-7597-4b26-8c8b-27f37a044cfc on user Apr 14 15:49:19 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041777 Apr 14 15:49:19 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 200/601] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:49:19 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:49:19 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc" status: 204 len: 0 microversion: 2.1 time: 0.164771 Apr 14 15:49:19 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 201/602] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:49:19 2023] DELETE /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:49:20 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-aaf713b3-cf80-4826-8a67-26e0f5c9d7ac tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:20 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-aaf713b3-cf80-4826-8a67-26e0f5c9d7ac tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aaf713b3-cf80-4826-8a67-26e0f5c9d7ac tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aaf713b3-cf80-4826-8a67-26e0f5c9d7ac tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aaf713b3-cf80-4826-8a67-26e0f5c9d7ac tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aaf713b3-cf80-4826-8a67-26e0f5c9d7ac tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aaf713b3-cf80-4826-8a67-26e0f5c9d7ac tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aaf713b3-cf80-4826-8a67-26e0f5c9d7ac tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:20 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-628cf9ae-9aa0-4be1-b470-040ce3e8114e tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:20 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-628cf9ae-9aa0-4be1-b470-040ce3e8114e tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-628cf9ae-9aa0-4be1-b470-040ce3e8114e tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-628cf9ae-9aa0-4be1-b470-040ce3e8114e tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-628cf9ae-9aa0-4be1-b470-040ce3e8114e tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-628cf9ae-9aa0-4be1-b470-040ce3e8114e tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-628cf9ae-9aa0-4be1-b470-040ce3e8114e tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-628cf9ae-9aa0-4be1-b470-040ce3e8114e tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:20 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-aaf713b3-cf80-4826-8a67-26e0f5c9d7ac tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:20 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-aaf713b3-cf80-4826-8a67-26e0f5c9d7ac tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 200 len: 1686 microversion: 2.1 time: 0.350048 Apr 14 15:49:20 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 202/603] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:49:19 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 1686 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:49:20 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f18d7393-5cf4-497c-bbe8-b261afa4cfb4"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:20 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:20 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-628cf9ae-9aa0-4be1-b470-040ce3e8114e tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855c585696694964974a8df948ab7899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac7fb012e144cdaa7da36ee9b590a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-628cf9ae-9aa0-4be1-b470-040ce3e8114e tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc" status: 200 len: 1662 microversion: 2.1 time: 0.782022 Apr 14 15:49:20 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 201/604] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:49:20 2023] GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc => generated 1662 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:49:20 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390777 Apr 14 15:49:20 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 202/605] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:49:20 2023] POST /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:21 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af42177f-7597-4b26-8c8b-27f37a044cfc", "name": "network-vif-unplugged", "status": "completed", "tag": "e2569358-6e39-46e0-a34b-6f67930a0295"}, {"server_uuid": "af42177f-7597-4b26-8c8b-27f37a044cfc", "name": "network-vif-plugged", "status": "completed", "tag": "e2569358-6e39-46e0-a34b-6f67930a0295"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] Creating event network-vif-unplugged:e2569358-6e39-46e0-a34b-6f67930a0295 for instance af42177f-7597-4b26-8c8b-27f37a044cfc on user Apr 14 15:49:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] Creating event network-vif-plugged:e2569358-6e39-46e0-a34b-6f67930a0295 for instance af42177f-7597-4b26-8c8b-27f37a044cfc on user Apr 14 15:49:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030950 Apr 14 15:49:21 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 203/606] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:21 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:22 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-90f5ff3c-3714-4574-b7f9-39fd89092453 req-fc15eb86-d1df-4f05-a7a0-a592eaa3c9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af42177f-7597-4b26-8c8b-27f37a044cfc", "name": "network-vif-deleted", "tag": "e2569358-6e39-46e0-a34b-6f67930a0295"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-90f5ff3c-3714-4574-b7f9-39fd89092453 req-fc15eb86-d1df-4f05-a7a0-a592eaa3c9f0 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-90f5ff3c-3714-4574-b7f9-39fd89092453 req-fc15eb86-d1df-4f05-a7a0-a592eaa3c9f0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-90f5ff3c-3714-4574-b7f9-39fd89092453 req-fc15eb86-d1df-4f05-a7a0-a592eaa3c9f0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:22 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-90f5ff3c-3714-4574-b7f9-39fd89092453 req-fc15eb86-d1df-4f05-a7a0-a592eaa3c9f0 service nova] Creating event network-vif-deleted:e2569358-6e39-46e0-a34b-6f67930a0295 for instance af42177f-7597-4b26-8c8b-27f37a044cfc on user Apr 14 15:49:22 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-90f5ff3c-3714-4574-b7f9-39fd89092453 req-fc15eb86-d1df-4f05-a7a0-a592eaa3c9f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031876 Apr 14 15:49:22 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 202/607] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:49:28 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-16db155e-bbe4-46a4-982b-08ebbc1eb2a1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:28 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-16db155e-bbe4-46a4-982b-08ebbc1eb2a1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-16db155e-bbe4-46a4-982b-08ebbc1eb2a1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-16db155e-bbe4-46a4-982b-08ebbc1eb2a1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-16db155e-bbe4-46a4-982b-08ebbc1eb2a1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-16db155e-bbe4-46a4-982b-08ebbc1eb2a1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-16db155e-bbe4-46a4-982b-08ebbc1eb2a1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-16db155e-bbe4-46a4-982b-08ebbc1eb2a1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:28 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-16db155e-bbe4-46a4-982b-08ebbc1eb2a1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-16db155e-bbe4-46a4-982b-08ebbc1eb2a1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4" status: 200 len: 1583 microversion: 2.1 time: 0.247286 Apr 14 15:49:28 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 203/608] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:49:28 2023] GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4 => generated 1583 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:49:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:31 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=15 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:31 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=31 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] Creating event network-changed:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:49:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046664 Apr 14 15:49:31 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 204/609] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:32 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=14 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:32 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:32 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-08236c41-a3d1-43b8-b034-520b08bbc9e9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1803971221"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:32 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-08236c41-a3d1-43b8-b034-520b08bbc9e9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-08236c41-a3d1-43b8-b034-520b08bbc9e9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-08236c41-a3d1-43b8-b034-520b08bbc9e9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-08236c41-a3d1-43b8-b034-520b08bbc9e9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-08236c41-a3d1-43b8-b034-520b08bbc9e9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-08236c41-a3d1-43b8-b034-520b08bbc9e9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-08236c41-a3d1-43b8-b034-520b08bbc9e9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:32 user devstack@n-api.service[61874]: INFO nova.network.security_group_api [None req-08236c41-a3d1-43b8-b034-520b08bbc9e9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Adding security group f2aaacf5-6b02-446e-9642-fad0e08ba832 to port 70eb36b4-9ffc-491e-aed2-56587d2d6d47 Apr 14 15:49:33 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-08236c41-a3d1-43b8-b034-520b08bbc9e9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/action" status: 202 len: 0 microversion: 2.1 time: 0.697320 Apr 14 15:49:33 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 203/610] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:49:32 2023] POST /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/action => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-116a5b0c-3deb-4833-b8f1-e0e12b9f7011 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-116a5b0c-3deb-4833-b8f1-e0e12b9f7011 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:33 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-116a5b0c-3deb-4833-b8f1-e0e12b9f7011 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-116a5b0c-3deb-4833-b8f1-e0e12b9f7011 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-116a5b0c-3deb-4833-b8f1-e0e12b9f7011 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-116a5b0c-3deb-4833-b8f1-e0e12b9f7011 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-116a5b0c-3deb-4833-b8f1-e0e12b9f7011 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-116a5b0c-3deb-4833-b8f1-e0e12b9f7011 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:33 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] Creating event network-changed:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:49:33 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032110 Apr 14 15:49:33 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 205/611] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-116a5b0c-3deb-4833-b8f1-e0e12b9f7011 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:33 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-116a5b0c-3deb-4833-b8f1-e0e12b9f7011 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4" status: 200 len: 1749 microversion: 2.1 time: 0.180586 Apr 14 15:49:33 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 204/612] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:49:33 2023] GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4 => generated 1749 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:49:33 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:33 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:33 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/action" status: 202 len: 0 microversion: 2.1 time: 0.089503 Apr 14 15:49:33 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 204/613] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:49:33 2023] POST /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:49:33 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6a15b43b-5461-4a3b-8e87-64749e4d3e29 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:33 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-6a15b43b-5461-4a3b-8e87-64749e4d3e29 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6a15b43b-5461-4a3b-8e87-64749e4d3e29 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6a15b43b-5461-4a3b-8e87-64749e4d3e29 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6a15b43b-5461-4a3b-8e87-64749e4d3e29 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6a15b43b-5461-4a3b-8e87-64749e4d3e29 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6a15b43b-5461-4a3b-8e87-64749e4d3e29 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6a15b43b-5461-4a3b-8e87-64749e4d3e29 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6df3a0f7-464a-4b2c-a8b6-7ea80bb3bf69 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-6df3a0f7-464a-4b2c-a8b6-7ea80bb3bf69 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6df3a0f7-464a-4b2c-a8b6-7ea80bb3bf69 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6df3a0f7-464a-4b2c-a8b6-7ea80bb3bf69 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6df3a0f7-464a-4b2c-a8b6-7ea80bb3bf69 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6df3a0f7-464a-4b2c-a8b6-7ea80bb3bf69 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6df3a0f7-464a-4b2c-a8b6-7ea80bb3bf69 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6df3a0f7-464a-4b2c-a8b6-7ea80bb3bf69 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:34 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-6a15b43b-5461-4a3b-8e87-64749e4d3e29 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6a15b43b-5461-4a3b-8e87-64749e4d3e29 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4" status: 200 len: 1741 microversion: 2.1 time: 0.308036 Apr 14 15:49:34 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 206/614] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:49:33 2023] GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4 => generated 1741 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 15:49:34 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-6df3a0f7-464a-4b2c-a8b6-7ea80bb3bf69 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:34 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-6df3a0f7-464a-4b2c-a8b6-7ea80bb3bf69 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1676 microversion: 2.1 time: 0.248558 Apr 14 15:49:34 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 205/615] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:49:33 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1676 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:49:34 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66cf9862-011c-4854-822b-3e74a77e5148"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:34 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302109 Apr 14 15:49:34 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 205/616] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:49:34 2023] POST /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:34 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-b6e38634-cebe-469a-8168-a29f491cdee3 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:34 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-b6e38634-cebe-469a-8168-a29f491cdee3 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b6e38634-cebe-469a-8168-a29f491cdee3 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b6e38634-cebe-469a-8168-a29f491cdee3 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b6e38634-cebe-469a-8168-a29f491cdee3 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b6e38634-cebe-469a-8168-a29f491cdee3 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b6e38634-cebe-469a-8168-a29f491cdee3 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b6e38634-cebe-469a-8168-a29f491cdee3 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-b6e38634-cebe-469a-8168-a29f491cdee3 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077145 Apr 14 15:49:34 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 207/617] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:49:34 2023] GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:49:37 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-72f0f1ed-34a0-4a3b-b6cb-f2046afeba88 req-84cdb966-2b7d-441a-a865-0cb3ac6dac5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "name": "network-vif-unplugged", "status": "completed", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:37 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-72f0f1ed-34a0-4a3b-b6cb-f2046afeba88 req-84cdb966-2b7d-441a-a865-0cb3ac6dac5d service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:37 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-72f0f1ed-34a0-4a3b-b6cb-f2046afeba88 req-84cdb966-2b7d-441a-a865-0cb3ac6dac5d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:37 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-72f0f1ed-34a0-4a3b-b6cb-f2046afeba88 req-84cdb966-2b7d-441a-a865-0cb3ac6dac5d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:37 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-72f0f1ed-34a0-4a3b-b6cb-f2046afeba88 req-84cdb966-2b7d-441a-a865-0cb3ac6dac5d service nova] Creating event network-vif-unplugged:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:49:37 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-72f0f1ed-34a0-4a3b-b6cb-f2046afeba88 req-84cdb966-2b7d-441a-a865-0cb3ac6dac5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047554 Apr 14 15:49:37 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 206/618] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:39 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-bfe178f1-bea3-4d86-b9ff-d6e7e111e0bf req-362f3173-91e6-4612-a222-004a3409b6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "name": "network-vif-plugged", "status": "completed", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-bfe178f1-bea3-4d86-b9ff-d6e7e111e0bf req-362f3173-91e6-4612-a222-004a3409b6d0 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-bfe178f1-bea3-4d86-b9ff-d6e7e111e0bf req-362f3173-91e6-4612-a222-004a3409b6d0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-bfe178f1-bea3-4d86-b9ff-d6e7e111e0bf req-362f3173-91e6-4612-a222-004a3409b6d0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:39 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-bfe178f1-bea3-4d86-b9ff-d6e7e111e0bf req-362f3173-91e6-4612-a222-004a3409b6d0 service nova] Creating event network-vif-plugged:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:49:39 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-bfe178f1-bea3-4d86-b9ff-d6e7e111e0bf req-362f3173-91e6-4612-a222-004a3409b6d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044288 Apr 14 15:49:39 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 206/619] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:41 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "name": "network-vif-plugged", "status": "completed", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}, {"server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "name": "network-vif-plugged", "status": "completed", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] Creating event network-vif-plugged:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:49:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] Creating event network-vif-plugged:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:49:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032196 Apr 14 15:49:41 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 208/620] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Old instance type m1.nano, new instance type m1.micro {{(pid=61875) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for project 95e26fa4727e46479d108fe49e225706. Resources: {'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for user 3062186c340a4cfe875d5455b0ace246 and project 95e26fa4727e46479d108fe49e225706. Resources: {'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:49:45 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:49:45 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/action" status: 202 len: 0 microversion: 2.1 time: 0.356302 Apr 14 15:49:45 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 207/621] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:49:45 2023] POST /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:49:45 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-77f8681b-8a79-4467-b05a-dae0db276477 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:45 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-77f8681b-8a79-4467-b05a-dae0db276477 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-77f8681b-8a79-4467-b05a-dae0db276477 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-77f8681b-8a79-4467-b05a-dae0db276477 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-77f8681b-8a79-4467-b05a-dae0db276477 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-77f8681b-8a79-4467-b05a-dae0db276477 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-77f8681b-8a79-4467-b05a-dae0db276477 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-77f8681b-8a79-4467-b05a-dae0db276477 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:46 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-77f8681b-8a79-4467-b05a-dae0db276477 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:46 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-77f8681b-8a79-4467-b05a-dae0db276477 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1731 microversion: 2.1 time: 0.297889 Apr 14 15:49:46 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 207/622] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:49:45 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1731 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:49:48 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-c33ddda5-f23d-4ce6-80d5-b8610b1e0186 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:49:48 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-c33ddda5-f23d-4ce6-80d5-b8610b1e0186 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:49:48 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c33ddda5-f23d-4ce6-80d5-b8610b1e0186 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:48 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c33ddda5-f23d-4ce6-80d5-b8610b1e0186 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:48 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c33ddda5-f23d-4ce6-80d5-b8610b1e0186 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:48 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c33ddda5-f23d-4ce6-80d5-b8610b1e0186 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:48 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c33ddda5-f23d-4ce6-80d5-b8610b1e0186 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:48 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c33ddda5-f23d-4ce6-80d5-b8610b1e0186 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:48 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-c33ddda5-f23d-4ce6-80d5-b8610b1e0186 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:48 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-c33ddda5-f23d-4ce6-80d5-b8610b1e0186 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:48 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-c33ddda5-f23d-4ce6-80d5-b8610b1e0186 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:49:48 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-c33ddda5-f23d-4ce6-80d5-b8610b1e0186 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb" status: 200 len: 1768 microversion: 2.87 time: 0.318161 Apr 14 15:49:48 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 209/623] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:49:48 2023] GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb => generated 1768 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:49:49 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-beaa916a-e274-48aa-86bc-f625deed9716 req-6f6afe39-85ed-43a8-b2ea-c56f63c183f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-unplugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-beaa916a-e274-48aa-86bc-f625deed9716 req-6f6afe39-85ed-43a8-b2ea-c56f63c183f0 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-beaa916a-e274-48aa-86bc-f625deed9716 req-6f6afe39-85ed-43a8-b2ea-c56f63c183f0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-beaa916a-e274-48aa-86bc-f625deed9716 req-6f6afe39-85ed-43a8-b2ea-c56f63c183f0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-beaa916a-e274-48aa-86bc-f625deed9716 req-6f6afe39-85ed-43a8-b2ea-c56f63c183f0 service nova] Creating event network-vif-unplugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:49:49 user devstack@n-api.service[61875]: DEBUG nova.compute.api [req-beaa916a-e274-48aa-86bc-f625deed9716 req-6f6afe39-85ed-43a8-b2ea-c56f63c183f0 service nova] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 15:49:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-beaa916a-e274-48aa-86bc-f625deed9716 req-6f6afe39-85ed-43a8-b2ea-c56f63c183f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050372 Apr 14 15:49:49 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 208/624] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:51 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-15c3e6b6-5b50-4081-af6b-5bc55358d8e3 req-2928f87b-1a3c-4ad4-8566-03aa0b3aa8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-plugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-15c3e6b6-5b50-4081-af6b-5bc55358d8e3 req-2928f87b-1a3c-4ad4-8566-03aa0b3aa8fd service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-15c3e6b6-5b50-4081-af6b-5bc55358d8e3 req-2928f87b-1a3c-4ad4-8566-03aa0b3aa8fd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-15c3e6b6-5b50-4081-af6b-5bc55358d8e3 req-2928f87b-1a3c-4ad4-8566-03aa0b3aa8fd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:51 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-15c3e6b6-5b50-4081-af6b-5bc55358d8e3 req-2928f87b-1a3c-4ad4-8566-03aa0b3aa8fd service nova] Creating event network-vif-plugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:49:51 user devstack@n-api.service[61874]: DEBUG nova.compute.api [req-15c3e6b6-5b50-4081-af6b-5bc55358d8e3 req-2928f87b-1a3c-4ad4-8566-03aa0b3aa8fd service nova] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61874) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 15:49:51 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-15c3e6b6-5b50-4081-af6b-5bc55358d8e3 req-2928f87b-1a3c-4ad4-8566-03aa0b3aa8fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058418 Apr 14 15:49:51 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 208/625] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:49:57 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc81318c-1157-4832-919a-28cc14431f48", "tag": "3f7d69ad-aaff-498b-8862-241238c91a38"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:49:57 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:49:57 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:49:57 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:49:57 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] Creating event network-changed:3f7d69ad-aaff-498b-8862-241238c91a38 for instance cc81318c-1157-4832-919a-28cc14431f48 on user Apr 14 15:49:57 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036673 Apr 14 15:49:57 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 210/626] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:49:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:00 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:00 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=15 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:00 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:00 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b1682a4a-496b-46ca-b680-218e62cb872b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:50:00 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-b1682a4a-496b-46ca-b680-218e62cb872b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:50:00 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b1682a4a-496b-46ca-b680-218e62cb872b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:00 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b1682a4a-496b-46ca-b680-218e62cb872b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:00 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b1682a4a-496b-46ca-b680-218e62cb872b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:00 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b1682a4a-496b-46ca-b680-218e62cb872b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:00 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b1682a4a-496b-46ca-b680-218e62cb872b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:00 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b1682a4a-496b-46ca-b680-218e62cb872b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:00 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-b1682a4a-496b-46ca-b680-218e62cb872b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:50:00 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-b1682a4a-496b-46ca-b680-218e62cb872b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" status: 200 len: 1717 microversion: 2.1 time: 0.318672 Apr 14 15:50:00 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 209/627] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:50:00 2023] GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => generated 1717 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:50:01 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:50:01 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:50:01 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:01 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:01 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:01 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:01 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:01 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:01 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:50:01 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48" status: 204 len: 0 microversion: 2.1 time: 0.145239 Apr 14 15:50:01 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 209/628] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:50:01 2023] DELETE /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:50:01 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-c96df29a-3dc7-40dd-ad97-8886e7b498f4 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:50:01 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-c96df29a-3dc7-40dd-ad97-8886e7b498f4 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:50:01 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=16 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c96df29a-3dc7-40dd-ad97-8886e7b498f4 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c96df29a-3dc7-40dd-ad97-8886e7b498f4 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c96df29a-3dc7-40dd-ad97-8886e7b498f4 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c96df29a-3dc7-40dd-ad97-8886e7b498f4 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c96df29a-3dc7-40dd-ad97-8886e7b498f4 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c96df29a-3dc7-40dd-ad97-8886e7b498f4 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:01 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=26 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:02 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-c96df29a-3dc7-40dd-ad97-8886e7b498f4 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee063f686de4a9f9e6b5fe1e7ce2c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737ea257ab5448389bd751841be0fc72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:50:02 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-c96df29a-3dc7-40dd-ad97-8886e7b498f4 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48" status: 200 len: 1575 microversion: 2.1 time: 0.966203 Apr 14 15:50:02 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 211/629] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:50:01 2023] GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48 => generated 1575 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:50:02 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-c45b7321-2b44-41d8-b2d6-59d189942df6 req-21615362-5dab-46d2-be0a-96fa0b545327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc81318c-1157-4832-919a-28cc14431f48", "name": "network-vif-unplugged", "status": "completed", "tag": "3f7d69ad-aaff-498b-8862-241238c91a38"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c45b7321-2b44-41d8-b2d6-59d189942df6 req-21615362-5dab-46d2-be0a-96fa0b545327 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c45b7321-2b44-41d8-b2d6-59d189942df6 req-21615362-5dab-46d2-be0a-96fa0b545327 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c45b7321-2b44-41d8-b2d6-59d189942df6 req-21615362-5dab-46d2-be0a-96fa0b545327 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c45b7321-2b44-41d8-b2d6-59d189942df6 req-21615362-5dab-46d2-be0a-96fa0b545327 service nova] Creating event network-vif-unplugged:3f7d69ad-aaff-498b-8862-241238c91a38 for instance cc81318c-1157-4832-919a-28cc14431f48 on user Apr 14 15:50:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-c45b7321-2b44-41d8-b2d6-59d189942df6 req-21615362-5dab-46d2-be0a-96fa0b545327 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029358 Apr 14 15:50:02 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 210/630] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:03 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-2255a441-c0d6-4187-be63-d4505364b6a2 req-eadf6b24-b79e-4a6b-848b-f615edb09982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc81318c-1157-4832-919a-28cc14431f48", "name": "network-vif-deleted", "tag": "3f7d69ad-aaff-498b-8862-241238c91a38"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:03 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-2255a441-c0d6-4187-be63-d4505364b6a2 req-eadf6b24-b79e-4a6b-848b-f615edb09982 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-2255a441-c0d6-4187-be63-d4505364b6a2 req-eadf6b24-b79e-4a6b-848b-f615edb09982 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-2255a441-c0d6-4187-be63-d4505364b6a2 req-eadf6b24-b79e-4a6b-848b-f615edb09982 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:03 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:03 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-2255a441-c0d6-4187-be63-d4505364b6a2 req-eadf6b24-b79e-4a6b-848b-f615edb09982 service nova] Creating event network-vif-deleted:3f7d69ad-aaff-498b-8862-241238c91a38 for instance cc81318c-1157-4832-919a-28cc14431f48 on user Apr 14 15:50:03 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-2255a441-c0d6-4187-be63-d4505364b6a2 req-eadf6b24-b79e-4a6b-848b-f615edb09982 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039465 Apr 14 15:50:03 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 210/631] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:03 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-59f3fabe-c56e-451c-87fc-61a4bdebcbae req-734678bf-e5ac-4429-82e3-5074c925843c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-plugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-59f3fabe-c56e-451c-87fc-61a4bdebcbae req-734678bf-e5ac-4429-82e3-5074c925843c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-59f3fabe-c56e-451c-87fc-61a4bdebcbae req-734678bf-e5ac-4429-82e3-5074c925843c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-59f3fabe-c56e-451c-87fc-61a4bdebcbae req-734678bf-e5ac-4429-82e3-5074c925843c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:03 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-59f3fabe-c56e-451c-87fc-61a4bdebcbae req-734678bf-e5ac-4429-82e3-5074c925843c service nova] Creating event network-vif-plugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:50:03 user devstack@n-api.service[61876]: DEBUG nova.compute.api [req-59f3fabe-c56e-451c-87fc-61a4bdebcbae req-734678bf-e5ac-4429-82e3-5074c925843c service nova] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 15:50:03 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-59f3fabe-c56e-451c-87fc-61a4bdebcbae req-734678bf-e5ac-4429-82e3-5074c925843c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053934 Apr 14 15:50:03 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 212/632] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:04 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-35fdd187-4402-4dd9-a303-27ace29dd325 req-565dc033-3103-4af9-9bee-b118248117a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc81318c-1157-4832-919a-28cc14431f48", "name": "network-vif-plugged", "status": "completed", "tag": "3f7d69ad-aaff-498b-8862-241238c91a38"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-35fdd187-4402-4dd9-a303-27ace29dd325 req-565dc033-3103-4af9-9bee-b118248117a3 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-35fdd187-4402-4dd9-a303-27ace29dd325 req-565dc033-3103-4af9-9bee-b118248117a3 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-35fdd187-4402-4dd9-a303-27ace29dd325 req-565dc033-3103-4af9-9bee-b118248117a3 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-35fdd187-4402-4dd9-a303-27ace29dd325 req-565dc033-3103-4af9-9bee-b118248117a3 service nova] Creating event network-vif-plugged:3f7d69ad-aaff-498b-8862-241238c91a38 for instance cc81318c-1157-4832-919a-28cc14431f48 on user Apr 14 15:50:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-35fdd187-4402-4dd9-a303-27ace29dd325 req-565dc033-3103-4af9-9bee-b118248117a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031069 Apr 14 15:50:04 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 211/633] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:05 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-9502c460-a3a2-4397-bf62-f53a63951653 req-3e719a6f-28bd-44c0-b6c3-86eec3086747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-plugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9502c460-a3a2-4397-bf62-f53a63951653 req-3e719a6f-28bd-44c0-b6c3-86eec3086747 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9502c460-a3a2-4397-bf62-f53a63951653 req-3e719a6f-28bd-44c0-b6c3-86eec3086747 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9502c460-a3a2-4397-bf62-f53a63951653 req-3e719a6f-28bd-44c0-b6c3-86eec3086747 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:05 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-9502c460-a3a2-4397-bf62-f53a63951653 req-3e719a6f-28bd-44c0-b6c3-86eec3086747 service nova] Creating event network-vif-plugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:50:05 user devstack@n-api.service[61874]: DEBUG nova.compute.api [req-9502c460-a3a2-4397-bf62-f53a63951653 req-3e719a6f-28bd-44c0-b6c3-86eec3086747 service nova] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61874) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 15:50:05 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-9502c460-a3a2-4397-bf62-f53a63951653 req-3e719a6f-28bd-44c0-b6c3-86eec3086747 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036496 Apr 14 15:50:05 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 211/634] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:10 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-bcc9e2de-2728-408b-9cc4-b38dfe5fcbda tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:50:10 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-bcc9e2de-2728-408b-9cc4-b38dfe5fcbda tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:50:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bcc9e2de-2728-408b-9cc4-b38dfe5fcbda tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bcc9e2de-2728-408b-9cc4-b38dfe5fcbda tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bcc9e2de-2728-408b-9cc4-b38dfe5fcbda tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bcc9e2de-2728-408b-9cc4-b38dfe5fcbda tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bcc9e2de-2728-408b-9cc4-b38dfe5fcbda tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bcc9e2de-2728-408b-9cc4-b38dfe5fcbda tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-bcc9e2de-2728-408b-9cc4-b38dfe5fcbda tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] HTTP exception thrown: Instance af42177f-7597-4b26-8c8b-27f37a044cfc could not be found. Apr 14 15:50:10 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-bcc9e2de-2728-408b-9cc4-b38dfe5fcbda tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Request method failure captured: Apr 14 15:50:10 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc HTTP/1.1 Apr 14 15:50:10 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:50:10 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:50:10 user devstack@n-api.service[61876]: Connection: close Apr 14 15:50:10 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:50:10 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:50:10 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:50:10 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:50:10 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXSG-REv2sX_4cCYm4suasKncKW9Gw7w0KW_4v8t800fOasaSWGDb49F2VmaLXL6CjM7-PLY5A-AYPvp6LX4E_MaGseQi-KzJL_q1n3YrQC13rWRN4CIcoqRhbKvAQAconJzKSja2FzdpqTPuhYonUDq2LMXvQCHOer4V4YaIKQpcUA Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Project-Id: d1ac7fb012e144cdaa7da36ee9b590a0 Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Project-Name: tempest-TestStampPattern-2099461179 Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1ac7fb012e144cdaa7da36ee9b590a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1ac7fb012e144cdaa7da36ee9b590a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1ac7fb012e144cdaa7da36ee9b590a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Tenant: tempest-TestStampPattern-2099461179 Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Tenant-Id: d1ac7fb012e144cdaa7da36ee9b590a0 Apr 14 15:50:10 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-TestStampPattern-2099461179 Apr 14 15:50:10 user devstack@n-api.service[61876]: X-User: tempest-TestStampPattern-2099461179-project-member Apr 14 15:50:10 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:50:10 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:50:10 user devstack@n-api.service[61876]: X-User-Id: 855c585696694964974a8df948ab7899 Apr 14 15:50:10 user devstack@n-api.service[61876]: X-User-Name: tempest-TestStampPattern-2099461179-project-member Apr 14 15:50:10 user devstack@n-api.service[61876]: method: > Apr 14 15:50:10 user devstack@n-api.service[61876]: exception: Instance af42177f-7597-4b26-8c8b-27f37a044cfc could not be found. Apr 14 15:50:10 user devstack@n-api.service[61876]: action_args: {'id': 'af42177f-7597-4b26-8c8b-27f37a044cfc'} Apr 14 15:50:10 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af42177f-7597-4b26-8c8b-27f37a044cfc could not be found. Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af42177f-7597-4b26-8c8b-27f37a044cfc could not be found. Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af42177f-7597-4b26-8c8b-27f37a044cfc could not be found. Apr 14 15:50:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:50:10 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-bcc9e2de-2728-408b-9cc4-b38dfe5fcbda tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Returning 404 to user: Instance af42177f-7597-4b26-8c8b-27f37a044cfc could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:50:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-bcc9e2de-2728-408b-9cc4-b38dfe5fcbda tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc" status: 404 len: 111 microversion: 2.1 time: 0.030905 Apr 14 15:50:10 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 213/635] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:50:10 2023] GET /compute/v2.1/servers/af42177f-7597-4b26-8c8b-27f37a044cfc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:50:17 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-5f865da5-c82c-4562-972d-9ac49e18f0cc tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:50:17 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-5f865da5-c82c-4562-972d-9ac49e18f0cc tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:50:17 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:17 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=10 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5f865da5-c82c-4562-972d-9ac49e18f0cc tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5f865da5-c82c-4562-972d-9ac49e18f0cc tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5f865da5-c82c-4562-972d-9ac49e18f0cc tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5f865da5-c82c-4562-972d-9ac49e18f0cc tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5f865da5-c82c-4562-972d-9ac49e18f0cc tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5f865da5-c82c-4562-972d-9ac49e18f0cc tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:17 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-5f865da5-c82c-4562-972d-9ac49e18f0cc tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] HTTP exception thrown: Instance 203e4039-aa71-4521-8e74-02452436cb60 is not attached to volume e0991f31-aa0c-498b-934c-109652675c69 Apr 14 15:50:17 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-5f865da5-c82c-4562-972d-9ac49e18f0cc tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Request method failure captured: Apr 14 15:50:17 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60/os-volume_attachments/e0991f31-aa0c-498b-934c-109652675c69 HTTP/1.1 Apr 14 15:50:17 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:50:17 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:50:17 user devstack@n-api.service[61875]: Connection: close Apr 14 15:50:17 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:50:17 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:50:17 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:50:17 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:50:17 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXSG-REv2sX_4cCYm4suasKncKW9Gw7w0KW_4v8t800fOasaSWGDb49F2VmaLXL6CjM7-PLY5A-AYPvp6LX4E_MaGseQi-KzJL_q1n3YrQC13rWRN4CIcoqRhbKvAQAconJzKSja2FzdpqTPuhYonUDq2LMXvQCHOer4V4YaIKQpcUA Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Project-Id: d1ac7fb012e144cdaa7da36ee9b590a0 Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Project-Name: tempest-TestStampPattern-2099461179 Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1ac7fb012e144cdaa7da36ee9b590a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1ac7fb012e144cdaa7da36ee9b590a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1ac7fb012e144cdaa7da36ee9b590a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Tenant: tempest-TestStampPattern-2099461179 Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Tenant-Id: d1ac7fb012e144cdaa7da36ee9b590a0 Apr 14 15:50:17 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-TestStampPattern-2099461179 Apr 14 15:50:17 user devstack@n-api.service[61875]: X-User: tempest-TestStampPattern-2099461179-project-member Apr 14 15:50:17 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:50:17 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:50:17 user devstack@n-api.service[61875]: X-User-Id: 855c585696694964974a8df948ab7899 Apr 14 15:50:17 user devstack@n-api.service[61875]: X-User-Name: tempest-TestStampPattern-2099461179-project-member Apr 14 15:50:17 user devstack@n-api.service[61875]: method: > Apr 14 15:50:17 user devstack@n-api.service[61875]: exception: Instance 203e4039-aa71-4521-8e74-02452436cb60 is not attached to volume e0991f31-aa0c-498b-934c-109652675c69 Apr 14 15:50:17 user devstack@n-api.service[61875]: action_args: {'server_id': '203e4039-aa71-4521-8e74-02452436cb60', 'id': 'e0991f31-aa0c-498b-934c-109652675c69'} Apr 14 15:50:17 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e0991f31-aa0c-498b-934c-109652675c69. Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 203e4039-aa71-4521-8e74-02452436cb60 is not attached to volume e0991f31-aa0c-498b-934c-109652675c69 Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 203e4039-aa71-4521-8e74-02452436cb60 is not attached to volume e0991f31-aa0c-498b-934c-109652675c69 Apr 14 15:50:17 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:50:17 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-5f865da5-c82c-4562-972d-9ac49e18f0cc tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Returning 404 to user: Instance 203e4039-aa71-4521-8e74-02452436cb60 is not attached to volume e0991f31-aa0c-498b-934c-109652675c69 {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:50:17 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-5f865da5-c82c-4562-972d-9ac49e18f0cc tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60/os-volume_attachments/e0991f31-aa0c-498b-934c-109652675c69" status: 404 len: 154 microversion: 2.1 time: 0.096067 Apr 14 15:50:17 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 212/636] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:50:17 2023] DELETE /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60/os-volume_attachments/e0991f31-aa0c-498b-934c-109652675c69 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:50:18 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:18 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203e4039-aa71-4521-8e74-02452436cb60", "tag": "59970400-49c0-4153-85a7-7b9b9496df26"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:18 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=5 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:18 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:50:18 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:50:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:18 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:18 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] Creating event network-changed:59970400-49c0-4153-85a7-7b9b9496df26 for instance 203e4039-aa71-4521-8e74-02452436cb60 on user Apr 14 15:50:18 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033636 Apr 14 15:50:18 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 214/637] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:18 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:50:18 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60" status: 204 len: 0 microversion: 2.1 time: 0.121811 Apr 14 15:50:18 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 212/638] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:50:18 2023] DELETE /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:50:18 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-22e4dcdd-fc68-479c-9826-1c6630e6ef98 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:50:18 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-22e4dcdd-fc68-479c-9826-1c6630e6ef98 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:50:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-22e4dcdd-fc68-479c-9826-1c6630e6ef98 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-22e4dcdd-fc68-479c-9826-1c6630e6ef98 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-22e4dcdd-fc68-479c-9826-1c6630e6ef98 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-22e4dcdd-fc68-479c-9826-1c6630e6ef98 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-22e4dcdd-fc68-479c-9826-1c6630e6ef98 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-22e4dcdd-fc68-479c-9826-1c6630e6ef98 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:19 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-22e4dcdd-fc68-479c-9826-1c6630e6ef98 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855c585696694964974a8df948ab7899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac7fb012e144cdaa7da36ee9b590a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:50:19 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-22e4dcdd-fc68-479c-9826-1c6630e6ef98 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60" status: 200 len: 1662 microversion: 2.1 time: 0.584239 Apr 14 15:50:19 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 213/639] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:50:18 2023] GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60 => generated 1662 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:50:19 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-1486ac94-a5b8-4768-9d38-4b415b3d62ad req-51cdee38-4e13-4f72-b349-23e714c7d41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203e4039-aa71-4521-8e74-02452436cb60", "name": "network-vif-unplugged", "status": "completed", "tag": "59970400-49c0-4153-85a7-7b9b9496df26"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-1486ac94-a5b8-4768-9d38-4b415b3d62ad req-51cdee38-4e13-4f72-b349-23e714c7d41f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-1486ac94-a5b8-4768-9d38-4b415b3d62ad req-51cdee38-4e13-4f72-b349-23e714c7d41f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-1486ac94-a5b8-4768-9d38-4b415b3d62ad req-51cdee38-4e13-4f72-b349-23e714c7d41f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:19 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-1486ac94-a5b8-4768-9d38-4b415b3d62ad req-51cdee38-4e13-4f72-b349-23e714c7d41f service nova] Creating event network-vif-unplugged:59970400-49c0-4153-85a7-7b9b9496df26 for instance 203e4039-aa71-4521-8e74-02452436cb60 on user Apr 14 15:50:19 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-1486ac94-a5b8-4768-9d38-4b415b3d62ad req-51cdee38-4e13-4f72-b349-23e714c7d41f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028989 Apr 14 15:50:19 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 215/640] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:20 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-fe8d27b4-c0b9-403e-b86d-a8b911ba299d req-c90a2b8b-b5b0-4d74-b844-b7d912b7a6bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203e4039-aa71-4521-8e74-02452436cb60", "name": "network-vif-deleted", "tag": "59970400-49c0-4153-85a7-7b9b9496df26"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-fe8d27b4-c0b9-403e-b86d-a8b911ba299d req-c90a2b8b-b5b0-4d74-b844-b7d912b7a6bb service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-fe8d27b4-c0b9-403e-b86d-a8b911ba299d req-c90a2b8b-b5b0-4d74-b844-b7d912b7a6bb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-fe8d27b4-c0b9-403e-b86d-a8b911ba299d req-c90a2b8b-b5b0-4d74-b844-b7d912b7a6bb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-fe8d27b4-c0b9-403e-b86d-a8b911ba299d req-c90a2b8b-b5b0-4d74-b844-b7d912b7a6bb service nova] Creating event network-vif-deleted:59970400-49c0-4153-85a7-7b9b9496df26 for instance 203e4039-aa71-4521-8e74-02452436cb60 on user Apr 14 15:50:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-fe8d27b4-c0b9-403e-b86d-a8b911ba299d req-c90a2b8b-b5b0-4d74-b844-b7d912b7a6bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036941 Apr 14 15:50:20 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 213/641] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:20 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:20 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Going to try to start instance {{(pid=61875) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 15:50:20 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/action" status: 202 len: 0 microversion: 2.1 time: 0.076707 Apr 14 15:50:20 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 214/642] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:50:20 2023] POST /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:50:20 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ad798bc2-9673-4e74-bcbd-9929c883366d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:50:20 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ad798bc2-9673-4e74-bcbd-9929c883366d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:50:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad798bc2-9673-4e74-bcbd-9929c883366d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad798bc2-9673-4e74-bcbd-9929c883366d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad798bc2-9673-4e74-bcbd-9929c883366d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad798bc2-9673-4e74-bcbd-9929c883366d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad798bc2-9673-4e74-bcbd-9929c883366d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad798bc2-9673-4e74-bcbd-9929c883366d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:20 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-ad798bc2-9673-4e74-bcbd-9929c883366d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:50:20 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ad798bc2-9673-4e74-bcbd-9929c883366d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 200 len: 1695 microversion: 2.1 time: 0.226858 Apr 14 15:50:20 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 216/643] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:50:20 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 1695 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:50:21 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-9a5644c6-6a9e-461b-9f1f-66bb82519355 req-e660ab9f-ea15-496d-a2ea-27a7b759604a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203e4039-aa71-4521-8e74-02452436cb60", "name": "network-vif-plugged", "status": "completed", "tag": "59970400-49c0-4153-85a7-7b9b9496df26"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9a5644c6-6a9e-461b-9f1f-66bb82519355 req-e660ab9f-ea15-496d-a2ea-27a7b759604a service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9a5644c6-6a9e-461b-9f1f-66bb82519355 req-e660ab9f-ea15-496d-a2ea-27a7b759604a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9a5644c6-6a9e-461b-9f1f-66bb82519355 req-e660ab9f-ea15-496d-a2ea-27a7b759604a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:21 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-9a5644c6-6a9e-461b-9f1f-66bb82519355 req-e660ab9f-ea15-496d-a2ea-27a7b759604a service nova] Creating event network-vif-plugged:59970400-49c0-4153-85a7-7b9b9496df26 for instance 203e4039-aa71-4521-8e74-02452436cb60 on user Apr 14 15:50:21 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-9a5644c6-6a9e-461b-9f1f-66bb82519355 req-e660ab9f-ea15-496d-a2ea-27a7b759604a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033381 Apr 14 15:50:21 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 214/644] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:24 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-4fd836a9-d39b-476f-b8c2-64aaad4bbb12 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:50:24 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-4fd836a9-d39b-476f-b8c2-64aaad4bbb12 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:50:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4fd836a9-d39b-476f-b8c2-64aaad4bbb12 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4fd836a9-d39b-476f-b8c2-64aaad4bbb12 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4fd836a9-d39b-476f-b8c2-64aaad4bbb12 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4fd836a9-d39b-476f-b8c2-64aaad4bbb12 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4fd836a9-d39b-476f-b8c2-64aaad4bbb12 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-4fd836a9-d39b-476f-b8c2-64aaad4bbb12 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:24 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-4fd836a9-d39b-476f-b8c2-64aaad4bbb12 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:50:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-4fd836a9-d39b-476f-b8c2-64aaad4bbb12 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4" status: 200 len: 1749 microversion: 2.1 time: 0.233786 Apr 14 15:50:24 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 215/645] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:50:24 2023] GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4 => generated 1749 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:50:25 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-168f1b4a-979c-4a21-9ce3-3966895a514b req-98826931-a476-4863-80c6-5c63d6502f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-plugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-168f1b4a-979c-4a21-9ce3-3966895a514b req-98826931-a476-4863-80c6-5c63d6502f8f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-168f1b4a-979c-4a21-9ce3-3966895a514b req-98826931-a476-4863-80c6-5c63d6502f8f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-168f1b4a-979c-4a21-9ce3-3966895a514b req-98826931-a476-4863-80c6-5c63d6502f8f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-168f1b4a-979c-4a21-9ce3-3966895a514b req-98826931-a476-4863-80c6-5c63d6502f8f service nova] Creating event network-vif-plugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:50:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-168f1b4a-979c-4a21-9ce3-3966895a514b req-98826931-a476-4863-80c6-5c63d6502f8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043727 Apr 14 15:50:25 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 217/646] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:27 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-f9737f2f-0ec7-4f3d-ab3d-7be03fb5a82c req-2ce4081b-95c1-4a35-a34d-dd1dcc085834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-plugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f9737f2f-0ec7-4f3d-ab3d-7be03fb5a82c req-2ce4081b-95c1-4a35-a34d-dd1dcc085834 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f9737f2f-0ec7-4f3d-ab3d-7be03fb5a82c req-2ce4081b-95c1-4a35-a34d-dd1dcc085834 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f9737f2f-0ec7-4f3d-ab3d-7be03fb5a82c req-2ce4081b-95c1-4a35-a34d-dd1dcc085834 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:27 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-f9737f2f-0ec7-4f3d-ab3d-7be03fb5a82c req-2ce4081b-95c1-4a35-a34d-dd1dcc085834 service nova] Creating event network-vif-plugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:50:27 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-f9737f2f-0ec7-4f3d-ab3d-7be03fb5a82c req-2ce4081b-95c1-4a35-a34d-dd1dcc085834 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032209 Apr 14 15:50:27 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 215/647] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:36 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=8 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:36 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:36 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-0ac872cf-b2a1-4e7c-9860-8aee0c85d186 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:50:36 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-0ac872cf-b2a1-4e7c-9860-8aee0c85d186 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:50:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0ac872cf-b2a1-4e7c-9860-8aee0c85d186 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0ac872cf-b2a1-4e7c-9860-8aee0c85d186 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0ac872cf-b2a1-4e7c-9860-8aee0c85d186 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0ac872cf-b2a1-4e7c-9860-8aee0c85d186 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0ac872cf-b2a1-4e7c-9860-8aee0c85d186 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0ac872cf-b2a1-4e7c-9860-8aee0c85d186 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:36 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-0ac872cf-b2a1-4e7c-9860-8aee0c85d186 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:50:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-0ac872cf-b2a1-4e7c-9860-8aee0c85d186 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1730 microversion: 2.1 time: 0.313812 Apr 14 15:50:36 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 216/648] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:50:36 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1730 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:50:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=13 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=23 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:49 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "475ecb27-c654-4a52-abae-4a9ca316134d"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:49 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:50:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:49 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'flavor' on Instance uuid 0514ed4d-d911-4d2a-b1eb-8373e72894eb {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:50:49 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb/action" status: 200 len: 29 microversion: 2.87 time: 0.468123 Apr 14 15:50:49 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 218/649] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 15:50:49 2023] POST /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb/action => generated 29 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:50:49 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:49 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:49 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3f5fb2f8-24b9-40e8-acca-d587f0c42bea tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:50:49 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-3f5fb2f8-24b9-40e8-acca-d587f0c42bea tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:50:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3f5fb2f8-24b9-40e8-acca-d587f0c42bea tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3f5fb2f8-24b9-40e8-acca-d587f0c42bea tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3f5fb2f8-24b9-40e8-acca-d587f0c42bea tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3f5fb2f8-24b9-40e8-acca-d587f0c42bea tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3f5fb2f8-24b9-40e8-acca-d587f0c42bea tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3f5fb2f8-24b9-40e8-acca-d587f0c42bea tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:49 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-3f5fb2f8-24b9-40e8-acca-d587f0c42bea tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:50:49 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-3f5fb2f8-24b9-40e8-acca-d587f0c42bea tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:50:49 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-3f5fb2f8-24b9-40e8-acca-d587f0c42bea tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:50:49 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-3f5fb2f8-24b9-40e8-acca-d587f0c42bea tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb" status: 200 len: 1774 microversion: 2.87 time: 0.259672 Apr 14 15:50:49 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 216/650] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:50:49 2023] GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb => generated 1774 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:50:51 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-bc188a28-6955-4fa0-81d6-aa0f2486b042 req-6f1e8400-885d-4a86-b4ba-4ac19a6335e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-unplugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:51 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:51 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:50:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-bc188a28-6955-4fa0-81d6-aa0f2486b042 req-6f1e8400-885d-4a86-b4ba-4ac19a6335e2 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-bc188a28-6955-4fa0-81d6-aa0f2486b042 req-6f1e8400-885d-4a86-b4ba-4ac19a6335e2 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-bc188a28-6955-4fa0-81d6-aa0f2486b042 req-6f1e8400-885d-4a86-b4ba-4ac19a6335e2 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:51 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-bc188a28-6955-4fa0-81d6-aa0f2486b042 req-6f1e8400-885d-4a86-b4ba-4ac19a6335e2 service nova] Creating event network-vif-unplugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:50:51 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-bc188a28-6955-4fa0-81d6-aa0f2486b042 req-6f1e8400-885d-4a86-b4ba-4ac19a6335e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037896 Apr 14 15:50:51 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 217/651] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-34ff7f3c-01b2-42cf-a403-bc6323f71b5b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:50:52 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-34ff7f3c-01b2-42cf-a403-bc6323f71b5b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:50:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-34ff7f3c-01b2-42cf-a403-bc6323f71b5b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-34ff7f3c-01b2-42cf-a403-bc6323f71b5b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-34ff7f3c-01b2-42cf-a403-bc6323f71b5b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-34ff7f3c-01b2-42cf-a403-bc6323f71b5b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-34ff7f3c-01b2-42cf-a403-bc6323f71b5b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-34ff7f3c-01b2-42cf-a403-bc6323f71b5b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-34ff7f3c-01b2-42cf-a403-bc6323f71b5b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] HTTP exception thrown: Instance cc81318c-1157-4832-919a-28cc14431f48 could not be found. Apr 14 15:50:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-34ff7f3c-01b2-42cf-a403-bc6323f71b5b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Request method failure captured: Apr 14 15:50:52 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48 HTTP/1.1 Apr 14 15:50:52 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:50:52 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:50:52 user devstack@n-api.service[61876]: Connection: close Apr 14 15:50:52 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:50:52 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:50:52 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:50:52 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:50:52 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXR-VFtd3-A_gLzibnne5RtsBAESiDpu7soOW_Tp7X4eJMXo4QLFI7-t8RTXGjxQs_y05TpJbtdbK1vj1Q-Xj86oSQ1HMuHFYCJbKH_KhjtF5tQHXAG3ylEre8XwnBdb8fJGA4XOq4-yfjWSNyxYxkKZnXI70IKLmK8XO1PfsXbJPGI Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Project-Id: 737ea257ab5448389bd751841be0fc72 Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1698287900 Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/737ea257ab5448389bd751841be0fc72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/737ea257ab5448389bd751841be0fc72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/737ea257ab5448389bd751841be0fc72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Tenant: tempest-SnapshotDataIntegrityTests-1698287900 Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Tenant-Id: 737ea257ab5448389bd751841be0fc72 Apr 14 15:50:52 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1698287900 Apr 14 15:50:52 user devstack@n-api.service[61876]: X-User: tempest-SnapshotDataIntegrityTests-1698287900-project-member Apr 14 15:50:52 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:50:52 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:50:52 user devstack@n-api.service[61876]: X-User-Id: 4ee063f686de4a9f9e6b5fe1e7ce2c3a Apr 14 15:50:52 user devstack@n-api.service[61876]: X-User-Name: tempest-SnapshotDataIntegrityTests-1698287900-project-member Apr 14 15:50:52 user devstack@n-api.service[61876]: method: > Apr 14 15:50:52 user devstack@n-api.service[61876]: exception: Instance cc81318c-1157-4832-919a-28cc14431f48 could not be found. Apr 14 15:50:52 user devstack@n-api.service[61876]: action_args: {'id': 'cc81318c-1157-4832-919a-28cc14431f48'} Apr 14 15:50:52 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc81318c-1157-4832-919a-28cc14431f48 could not be found. Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc81318c-1157-4832-919a-28cc14431f48 could not be found. Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc81318c-1157-4832-919a-28cc14431f48 could not be found. Apr 14 15:50:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:50:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-34ff7f3c-01b2-42cf-a403-bc6323f71b5b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Returning 404 to user: Instance cc81318c-1157-4832-919a-28cc14431f48 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:50:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-34ff7f3c-01b2-42cf-a403-bc6323f71b5b tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48" status: 404 len: 111 microversion: 2.1 time: 0.028526 Apr 14 15:50:52 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 219/652] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:50:52 2023] GET /compute/v2.1/servers/cc81318c-1157-4832-919a-28cc14431f48 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:50:52 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-41c720df-c331-4160-9ab6-133c6ee10a52 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Calling method '.version_select at 0x7f2970bdbd90>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:50:52 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-41c720df-c331-4160-9ab6-133c6ee10a52 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-2098361315" status: 202 len: 0 microversion: 2.1 time: 0.060282 Apr 14 15:50:52 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 217/653] 10.0.0.210 () {62 vars in 1355 bytes} [Fri Apr 14 15:50:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-2098361315 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:50:53 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-7e291551-90a1-47c8-848a-108831fdb41e req-50bf7a4d-a545-4b8c-a9c3-46aeadb728da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-plugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:53 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7e291551-90a1-47c8-848a-108831fdb41e req-50bf7a4d-a545-4b8c-a9c3-46aeadb728da service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:53 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7e291551-90a1-47c8-848a-108831fdb41e req-50bf7a4d-a545-4b8c-a9c3-46aeadb728da service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:53 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7e291551-90a1-47c8-848a-108831fdb41e req-50bf7a4d-a545-4b8c-a9c3-46aeadb728da service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:53 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-7e291551-90a1-47c8-848a-108831fdb41e req-50bf7a4d-a545-4b8c-a9c3-46aeadb728da service nova] Creating event network-vif-plugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:50:53 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-7e291551-90a1-47c8-848a-108831fdb41e req-50bf7a4d-a545-4b8c-a9c3-46aeadb728da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042652 Apr 14 15:50:53 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 218/654] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:55 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-bbd879bf-45f2-4c35-a4b4-164572127ddd req-e9eff3f4-3ac8-47e0-95e6-031ac2d04159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-plugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-bbd879bf-45f2-4c35-a4b4-164572127ddd req-e9eff3f4-3ac8-47e0-95e6-031ac2d04159 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-bbd879bf-45f2-4c35-a4b4-164572127ddd req-e9eff3f4-3ac8-47e0-95e6-031ac2d04159 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-bbd879bf-45f2-4c35-a4b4-164572127ddd req-e9eff3f4-3ac8-47e0-95e6-031ac2d04159 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:55 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-bbd879bf-45f2-4c35-a4b4-164572127ddd req-e9eff3f4-3ac8-47e0-95e6-031ac2d04159 service nova] Creating event network-vif-plugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:50:55 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-bbd879bf-45f2-4c35-a4b4-164572127ddd req-e9eff3f4-3ac8-47e0-95e6-031ac2d04159 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028584 Apr 14 15:50:55 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 220/655] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:50:57 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-a7999146-517a-4d1e-8e49-850adcd449f8 req-a21ba13a-cc24-49d4-8738-1d51bcada84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-plugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:50:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a7999146-517a-4d1e-8e49-850adcd449f8 req-a21ba13a-cc24-49d4-8738-1d51bcada84e service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:50:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a7999146-517a-4d1e-8e49-850adcd449f8 req-a21ba13a-cc24-49d4-8738-1d51bcada84e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:50:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a7999146-517a-4d1e-8e49-850adcd449f8 req-a21ba13a-cc24-49d4-8738-1d51bcada84e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:50:57 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-a7999146-517a-4d1e-8e49-850adcd449f8 req-a21ba13a-cc24-49d4-8738-1d51bcada84e service nova] Creating event network-vif-plugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:50:57 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-a7999146-517a-4d1e-8e49-850adcd449f8 req-a21ba13a-cc24-49d4-8738-1d51bcada84e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030270 Apr 14 15:50:57 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 218/656] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:50:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:51:00 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-28a40a31-7077-4002-a8b4-10c9e1b6f99f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:51:00 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-28a40a31-7077-4002-a8b4-10c9e1b6f99f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:00 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-28a40a31-7077-4002-a8b4-10c9e1b6f99f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:00 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-28a40a31-7077-4002-a8b4-10c9e1b6f99f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:00 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-28a40a31-7077-4002-a8b4-10c9e1b6f99f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:00 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-28a40a31-7077-4002-a8b4-10c9e1b6f99f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:00 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-28a40a31-7077-4002-a8b4-10c9e1b6f99f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:00 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-28a40a31-7077-4002-a8b4-10c9e1b6f99f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:00 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-28a40a31-7077-4002-a8b4-10c9e1b6f99f tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.276340 Apr 14 15:51:00 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 219/657] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 15:51:00 2023] GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-interface => generated 282 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:51:01 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:51:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] Creating event network-changed:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:51:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030479 Apr 14 15:51:01 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 221/658] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:51:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:51:01 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:51:01 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:01 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:01 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:01 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:01 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:01 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:01 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:02 user devstack@n-api.service[61874]: DEBUG nova.objects.instance [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'services' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=61874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:51:02 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-volume_attachments/11765086-22f8-49da-9ddf-855ca5edd6c5" status: 202 len: 0 microversion: 2.1 time: 0.167338 Apr 14 15:51:02 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 219/659] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:51:01 2023] DELETE /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-volume_attachments/11765086-22f8-49da-9ddf-855ca5edd6c5 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:51:02 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-eb6fef95-72bc-4f0e-8d37-86ef040a9dde tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:51:02 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-eb6fef95-72bc-4f0e-8d37-86ef040a9dde tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-eb6fef95-72bc-4f0e-8d37-86ef040a9dde tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-eb6fef95-72bc-4f0e-8d37-86ef040a9dde tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-eb6fef95-72bc-4f0e-8d37-86ef040a9dde tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-eb6fef95-72bc-4f0e-8d37-86ef040a9dde tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-eb6fef95-72bc-4f0e-8d37-86ef040a9dde tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-eb6fef95-72bc-4f0e-8d37-86ef040a9dde tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-eb6fef95-72bc-4f0e-8d37-86ef040a9dde tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066454 Apr 14 15:51:02 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 220/660] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:51:02 2023] GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:51:03 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:51:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:03 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] Creating event network-changed:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:51:03 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029265 Apr 14 15:51:03 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 222/661] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:51:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:51:09 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-850daa58-1fa4-4670-950b-f54aa5ba1ee2 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:51:09 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-850daa58-1fa4-4670-950b-f54aa5ba1ee2 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-850daa58-1fa4-4670-950b-f54aa5ba1ee2 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-850daa58-1fa4-4670-950b-f54aa5ba1ee2 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-850daa58-1fa4-4670-950b-f54aa5ba1ee2 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-850daa58-1fa4-4670-950b-f54aa5ba1ee2 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-850daa58-1fa4-4670-950b-f54aa5ba1ee2 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-850daa58-1fa4-4670-950b-f54aa5ba1ee2 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-850daa58-1fa4-4670-950b-f54aa5ba1ee2 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] HTTP exception thrown: Instance 203e4039-aa71-4521-8e74-02452436cb60 could not be found. Apr 14 15:51:09 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-850daa58-1fa4-4670-950b-f54aa5ba1ee2 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Request method failure captured: Apr 14 15:51:09 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60 HTTP/1.1 Apr 14 15:51:09 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:51:09 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:51:09 user devstack@n-api.service[61874]: Connection: close Apr 14 15:51:09 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:51:09 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:51:09 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:51:09 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:51:09 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXSG-REv2sX_4cCYm4suasKncKW9Gw7w0KW_4v8t800fOasaSWGDb49F2VmaLXL6CjM7-PLY5A-AYPvp6LX4E_MaGseQi-KzJL_q1n3YrQC13rWRN4CIcoqRhbKvAQAconJzKSja2FzdpqTPuhYonUDq2LMXvQCHOer4V4YaIKQpcUA Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Project-Id: d1ac7fb012e144cdaa7da36ee9b590a0 Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Project-Name: tempest-TestStampPattern-2099461179 Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1ac7fb012e144cdaa7da36ee9b590a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1ac7fb012e144cdaa7da36ee9b590a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1ac7fb012e144cdaa7da36ee9b590a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Tenant: tempest-TestStampPattern-2099461179 Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Tenant-Id: d1ac7fb012e144cdaa7da36ee9b590a0 Apr 14 15:51:09 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-TestStampPattern-2099461179 Apr 14 15:51:09 user devstack@n-api.service[61874]: X-User: tempest-TestStampPattern-2099461179-project-member Apr 14 15:51:09 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:51:09 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:51:09 user devstack@n-api.service[61874]: X-User-Id: 855c585696694964974a8df948ab7899 Apr 14 15:51:09 user devstack@n-api.service[61874]: X-User-Name: tempest-TestStampPattern-2099461179-project-member Apr 14 15:51:09 user devstack@n-api.service[61874]: method: > Apr 14 15:51:09 user devstack@n-api.service[61874]: exception: Instance 203e4039-aa71-4521-8e74-02452436cb60 could not be found. Apr 14 15:51:09 user devstack@n-api.service[61874]: action_args: {'id': '203e4039-aa71-4521-8e74-02452436cb60'} Apr 14 15:51:09 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 203e4039-aa71-4521-8e74-02452436cb60 could not be found. Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 203e4039-aa71-4521-8e74-02452436cb60 could not be found. Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 203e4039-aa71-4521-8e74-02452436cb60 could not be found. Apr 14 15:51:09 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:51:09 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-850daa58-1fa4-4670-950b-f54aa5ba1ee2 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Returning 404 to user: Instance 203e4039-aa71-4521-8e74-02452436cb60 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:51:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-850daa58-1fa4-4670-950b-f54aa5ba1ee2 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60" status: 404 len: 111 microversion: 2.1 time: 0.032149 Apr 14 15:51:09 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 220/662] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:51:09 2023] GET /compute/v2.1/servers/203e4039-aa71-4521-8e74-02452436cb60 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:51:10 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-2322052c-e368-46bc-aff6-713a1b81f3e6 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:51:10 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-2322052c-e368-46bc-aff6-713a1b81f3e6 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2322052c-e368-46bc-aff6-713a1b81f3e6 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2322052c-e368-46bc-aff6-713a1b81f3e6 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2322052c-e368-46bc-aff6-713a1b81f3e6 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2322052c-e368-46bc-aff6-713a1b81f3e6 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2322052c-e368-46bc-aff6-713a1b81f3e6 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2322052c-e368-46bc-aff6-713a1b81f3e6 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:11 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-2322052c-e368-46bc-aff6-713a1b81f3e6 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:51:11 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-2322052c-e368-46bc-aff6-713a1b81f3e6 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 200 len: 1699 microversion: 2.1 time: 0.237885 Apr 14 15:51:11 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 221/663] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:51:10 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 1699 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:51:12 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-a2479c76-e052-4c27-be6f-a70d7a7b123c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Calling method '.version_select at 0x7f297084a4d0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:51:12 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-a2479c76-e052-4c27-be6f-a70d7a7b123c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1517680664" status: 202 len: 0 microversion: 2.1 time: 0.022043 Apr 14 15:51:12 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 223/664] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 15:51:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1517680664 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:51:24 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-72696cea-ac0d-4147-8464-98ca96ed83e0 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1803971221"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:51:24 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-72696cea-ac0d-4147-8464-98ca96ed83e0 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:24 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:24 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-72696cea-ac0d-4147-8464-98ca96ed83e0 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-72696cea-ac0d-4147-8464-98ca96ed83e0 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-72696cea-ac0d-4147-8464-98ca96ed83e0 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-72696cea-ac0d-4147-8464-98ca96ed83e0 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-72696cea-ac0d-4147-8464-98ca96ed83e0 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-72696cea-ac0d-4147-8464-98ca96ed83e0 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:24 user devstack@n-api.service[61874]: INFO nova.network.security_group_api [None req-72696cea-ac0d-4147-8464-98ca96ed83e0 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Removing security group f2aaacf5-6b02-446e-9642-fad0e08ba832 from port 70eb36b4-9ffc-491e-aed2-56587d2d6d47 Apr 14 15:51:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-72696cea-ac0d-4147-8464-98ca96ed83e0 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/action" status: 202 len: 0 microversion: 2.1 time: 0.967601 Apr 14 15:51:25 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 221/665] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:51:24 2023] POST /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/action => generated 0 bytes in 969 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:51:25 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:51:25 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=10 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:25 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=20 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] Creating event network-changed:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:51:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030575 Apr 14 15:51:25 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 222/666] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:51:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:51:26 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:26 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:26 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:51:26 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:26 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'services' on Instance uuid 9b7be2de-22e0-4639-ae89-856b4cfb17b4 {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:51:26 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/os-volume_attachments/f18d7393-5cf4-497c-bbe8-b261afa4cfb4" status: 202 len: 0 microversion: 2.1 time: 0.164607 Apr 14 15:51:26 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 224/667] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:51:26 2023] DELETE /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/os-volume_attachments/f18d7393-5cf4-497c-bbe8-b261afa4cfb4 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:51:26 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-728911e8-2a61-403d-ac83-e1a7d6cf38bf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:51:26 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-728911e8-2a61-403d-ac83-e1a7d6cf38bf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-728911e8-2a61-403d-ac83-e1a7d6cf38bf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-728911e8-2a61-403d-ac83-e1a7d6cf38bf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-728911e8-2a61-403d-ac83-e1a7d6cf38bf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-728911e8-2a61-403d-ac83-e1a7d6cf38bf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-728911e8-2a61-403d-ac83-e1a7d6cf38bf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-728911e8-2a61-403d-ac83-e1a7d6cf38bf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:26 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-728911e8-2a61-403d-ac83-e1a7d6cf38bf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046210 Apr 14 15:51:26 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 222/668] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:51:26 2023] GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:51:27 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:51:27 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:27 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:27 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:27 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] Creating event network-changed:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:51:27 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032152 Apr 14 15:51:27 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 223/669] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:51:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:51:36 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:36 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:36 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:51:36 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:36 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/action" status: 202 len: 0 microversion: 2.1 time: 0.226244 Apr 14 15:51:36 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 225/670] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:51:36 2023] POST /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:51:36 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-35bd8b9b-d666-4c54-94b1-97e01dc77326 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:51:36 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-35bd8b9b-d666-4c54-94b1-97e01dc77326 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:36 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:36 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=10 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-35bd8b9b-d666-4c54-94b1-97e01dc77326 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-35bd8b9b-d666-4c54-94b1-97e01dc77326 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-35bd8b9b-d666-4c54-94b1-97e01dc77326 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-35bd8b9b-d666-4c54-94b1-97e01dc77326 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-35bd8b9b-d666-4c54-94b1-97e01dc77326 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-35bd8b9b-d666-4c54-94b1-97e01dc77326 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:37 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-35bd8b9b-d666-4c54-94b1-97e01dc77326 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:51:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-35bd8b9b-d666-4c54-94b1-97e01dc77326 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1729 microversion: 2.1 time: 0.275029 Apr 14 15:51:37 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 223/671] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:51:36 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1729 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:51:38 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:38 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:38 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-69f65540-1ba5-4a71-86cc-8a53f5790709 req-aba3c5a7-04e0-4715-88bd-d0593bf12013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-unplugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:51:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-69f65540-1ba5-4a71-86cc-8a53f5790709 req-aba3c5a7-04e0-4715-88bd-d0593bf12013 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-69f65540-1ba5-4a71-86cc-8a53f5790709 req-aba3c5a7-04e0-4715-88bd-d0593bf12013 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-69f65540-1ba5-4a71-86cc-8a53f5790709 req-aba3c5a7-04e0-4715-88bd-d0593bf12013 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-69f65540-1ba5-4a71-86cc-8a53f5790709 req-aba3c5a7-04e0-4715-88bd-d0593bf12013 service nova] Creating event network-vif-unplugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:51:38 user devstack@n-api.service[61875]: DEBUG nova.compute.api [req-69f65540-1ba5-4a71-86cc-8a53f5790709 req-aba3c5a7-04e0-4715-88bd-d0593bf12013 service nova] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 15:51:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-69f65540-1ba5-4a71-86cc-8a53f5790709 req-aba3c5a7-04e0-4715-88bd-d0593bf12013 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040470 Apr 14 15:51:38 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 224/672] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:51:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:51:39 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-3d91cddb-c306-47b4-9fc7-8c20693383c8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:51:39 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-3d91cddb-c306-47b4-9fc7-8c20693383c8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3d91cddb-c306-47b4-9fc7-8c20693383c8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3d91cddb-c306-47b4-9fc7-8c20693383c8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3d91cddb-c306-47b4-9fc7-8c20693383c8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3d91cddb-c306-47b4-9fc7-8c20693383c8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3d91cddb-c306-47b4-9fc7-8c20693383c8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3d91cddb-c306-47b4-9fc7-8c20693383c8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:40 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-be19bc49-6cef-431f-86f3-c7c4ad1c3118 req-22872318-eb4a-4a0b-9c06-ffa54054e537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-plugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:51:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-be19bc49-6cef-431f-86f3-c7c4ad1c3118 req-22872318-eb4a-4a0b-9c06-ffa54054e537 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-be19bc49-6cef-431f-86f3-c7c4ad1c3118 req-22872318-eb4a-4a0b-9c06-ffa54054e537 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-be19bc49-6cef-431f-86f3-c7c4ad1c3118 req-22872318-eb4a-4a0b-9c06-ffa54054e537 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:40 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-be19bc49-6cef-431f-86f3-c7c4ad1c3118 req-22872318-eb4a-4a0b-9c06-ffa54054e537 service nova] Creating event network-vif-plugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:51:40 user devstack@n-api.service[61874]: DEBUG nova.compute.api [req-be19bc49-6cef-431f-86f3-c7c4ad1c3118 req-22872318-eb4a-4a0b-9c06-ffa54054e537 service nova] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61874) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 15:51:40 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-be19bc49-6cef-431f-86f3-c7c4ad1c3118 req-22872318-eb4a-4a0b-9c06-ffa54054e537 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039809 Apr 14 15:51:40 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 224/673] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:51:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:51:40 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-3d91cddb-c306-47b4-9fc7-8c20693383c8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:51:40 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-3d91cddb-c306-47b4-9fc7-8c20693383c8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:51:40 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-3d91cddb-c306-47b4-9fc7-8c20693383c8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:51:40 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-3d91cddb-c306-47b4-9fc7-8c20693383c8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb" status: 200 len: 1754 microversion: 2.87 time: 0.470100 Apr 14 15:51:40 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 226/674] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:51:39 2023] GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb => generated 1754 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:51:49 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:49 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:49 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-6285b08f-f40f-4300-b356-cc25ad2b1688 req-b22131dd-2a93-437d-96d4-54ebccf7b04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-plugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:51:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6285b08f-f40f-4300-b356-cc25ad2b1688 req-b22131dd-2a93-437d-96d4-54ebccf7b04f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6285b08f-f40f-4300-b356-cc25ad2b1688 req-b22131dd-2a93-437d-96d4-54ebccf7b04f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6285b08f-f40f-4300-b356-cc25ad2b1688 req-b22131dd-2a93-437d-96d4-54ebccf7b04f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:50 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-6285b08f-f40f-4300-b356-cc25ad2b1688 req-b22131dd-2a93-437d-96d4-54ebccf7b04f service nova] Creating event network-vif-plugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:51:50 user devstack@n-api.service[61875]: DEBUG nova.compute.api [req-6285b08f-f40f-4300-b356-cc25ad2b1688 req-b22131dd-2a93-437d-96d4-54ebccf7b04f service nova] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 15:51:50 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-6285b08f-f40f-4300-b356-cc25ad2b1688 req-b22131dd-2a93-437d-96d4-54ebccf7b04f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083060 Apr 14 15:51:50 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 225/675] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:51:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=10 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-0c064cd9-5d61-4cea-bb51-fd3d1bf371a9 req-8d4acbb2-ab8d-4d28-8190-010d2b8a83fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-plugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0c064cd9-5d61-4cea-bb51-fd3d1bf371a9 req-8d4acbb2-ab8d-4d28-8190-010d2b8a83fd service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0c064cd9-5d61-4cea-bb51-fd3d1bf371a9 req-8d4acbb2-ab8d-4d28-8190-010d2b8a83fd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0c064cd9-5d61-4cea-bb51-fd3d1bf371a9 req-8d4acbb2-ab8d-4d28-8190-010d2b8a83fd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:52 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-0c064cd9-5d61-4cea-bb51-fd3d1bf371a9 req-8d4acbb2-ab8d-4d28-8190-010d2b8a83fd service nova] Creating event network-vif-plugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG nova.compute.api [req-0c064cd9-5d61-4cea-bb51-fd3d1bf371a9 req-8d4acbb2-ab8d-4d28-8190-010d2b8a83fd service nova] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61874) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 15:51:52 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-0c064cd9-5d61-4cea-bb51-fd3d1bf371a9 req-8d4acbb2-ab8d-4d28-8190-010d2b8a83fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045596 Apr 14 15:51:52 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 225/676] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:51:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-77d4497b-d501-4569-9c82-29984d02cae9 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-77d4497b-d501-4569-9c82-29984d02cae9 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-77d4497b-d501-4569-9c82-29984d02cae9 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-77d4497b-d501-4569-9c82-29984d02cae9 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-77d4497b-d501-4569-9c82-29984d02cae9 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-77d4497b-d501-4569-9c82-29984d02cae9 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-77d4497b-d501-4569-9c82-29984d02cae9 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-77d4497b-d501-4569-9c82-29984d02cae9 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-77d4497b-d501-4569-9c82-29984d02cae9 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052299 Apr 14 15:51:52 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 227/677] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:51:52 2023] GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:51:52 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:51:52 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:52 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:51:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" status: 204 len: 0 microversion: 2.1 time: 0.145107 Apr 14 15:51:52 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 226/678] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:51:52 2023] DELETE /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-b2278619-7dde-46e3-9f0a-a3c1dec51694 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-b2278619-7dde-46e3-9f0a-a3c1dec51694 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b2278619-7dde-46e3-9f0a-a3c1dec51694 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b2278619-7dde-46e3-9f0a-a3c1dec51694 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b2278619-7dde-46e3-9f0a-a3c1dec51694 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b2278619-7dde-46e3-9f0a-a3c1dec51694 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b2278619-7dde-46e3-9f0a-a3c1dec51694 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b2278619-7dde-46e3-9f0a-a3c1dec51694 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-a2de992b-2f11-42b8-bf95-62d1e0eb53ca req-a679b717-3eb0-48ee-beb2-b04e25290150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "name": "network-vif-unplugged", "status": "completed", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:51:52 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-b2278619-7dde-46e3-9f0a-a3c1dec51694 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:51:52 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-b2278619-7dde-46e3-9f0a-a3c1dec51694 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" status: 200 len: 1677 microversion: 2.1 time: 0.319817 Apr 14 15:51:52 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 226/679] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:51:52 2023] GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => generated 1677 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a2de992b-2f11-42b8-bf95-62d1e0eb53ca req-a679b717-3eb0-48ee-beb2-b04e25290150 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a2de992b-2f11-42b8-bf95-62d1e0eb53ca req-a679b717-3eb0-48ee-beb2-b04e25290150 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a2de992b-2f11-42b8-bf95-62d1e0eb53ca req-a679b717-3eb0-48ee-beb2-b04e25290150 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-a2de992b-2f11-42b8-bf95-62d1e0eb53ca req-a679b717-3eb0-48ee-beb2-b04e25290150 service nova] Creating event network-vif-unplugged:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:51:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-a2de992b-2f11-42b8-bf95-62d1e0eb53ca req-a679b717-3eb0-48ee-beb2-b04e25290150 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059785 Apr 14 15:51:52 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 228/680] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:51:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:51:54 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-f50c2d03-d111-4858-ad48-12e2303b5c14 req-55f29f51-afb9-4ba3-9e20-a1abc8457efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "name": "network-vif-deleted", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:51:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-f50c2d03-d111-4858-ad48-12e2303b5c14 req-55f29f51-afb9-4ba3-9e20-a1abc8457efe service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-f50c2d03-d111-4858-ad48-12e2303b5c14 req-55f29f51-afb9-4ba3-9e20-a1abc8457efe service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-f50c2d03-d111-4858-ad48-12e2303b5c14 req-55f29f51-afb9-4ba3-9e20-a1abc8457efe service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:54 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-f50c2d03-d111-4858-ad48-12e2303b5c14 req-55f29f51-afb9-4ba3-9e20-a1abc8457efe service nova] Creating event network-vif-deleted:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:51:54 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-f50c2d03-d111-4858-ad48-12e2303b5c14 req-55f29f51-afb9-4ba3-9e20-a1abc8457efe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034708 Apr 14 15:51:54 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 227/681] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:51:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:51:54 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-9fccb7d4-120b-4df8-af06-6f5e572e0443 req-21eb7956-dc3d-40aa-8906-ede9a171eb44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72", "name": "network-vif-plugged", "status": "completed", "tag": "152ccc41-c6f1-40f5-9ea2-0449a4f45748"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:51:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9fccb7d4-120b-4df8-af06-6f5e572e0443 req-21eb7956-dc3d-40aa-8906-ede9a171eb44 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:51:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9fccb7d4-120b-4df8-af06-6f5e572e0443 req-21eb7956-dc3d-40aa-8906-ede9a171eb44 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:51:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9fccb7d4-120b-4df8-af06-6f5e572e0443 req-21eb7956-dc3d-40aa-8906-ede9a171eb44 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:51:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-9fccb7d4-120b-4df8-af06-6f5e572e0443 req-21eb7956-dc3d-40aa-8906-ede9a171eb44 service nova] Creating event network-vif-plugged:152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 on user Apr 14 15:51:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-9fccb7d4-120b-4df8-af06-6f5e572e0443 req-21eb7956-dc3d-40aa-8906-ede9a171eb44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032351 Apr 14 15:51:54 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 227/682] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:51:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:52:11 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:52:11 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:52:11 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:52:11 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:52:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:11 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'services' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:52:11 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/os-volume_attachments/4daa4e7f-db2c-483e-b08d-d0fef5d74897" status: 202 len: 0 microversion: 2.1 time: 0.262801 Apr 14 15:52:11 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 229/683] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:52:11 2023] DELETE /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/os-volume_attachments/4daa4e7f-db2c-483e-b08d-d0fef5d74897 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:52:13 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:52:13 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:52:13 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-33bda314-2284-40d4-b61c-c72e3d5848cd tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:52:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-33bda314-2284-40d4-b61c-c72e3d5848cd tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-33bda314-2284-40d4-b61c-c72e3d5848cd tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-33bda314-2284-40d4-b61c-c72e3d5848cd tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:14 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-33bda314-2284-40d4-b61c-c72e3d5848cd tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Going to try to stop instance {{(pid=61875) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 15:52:14 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-33bda314-2284-40d4-b61c-c72e3d5848cd tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/action" status: 202 len: 0 microversion: 2.1 time: 0.355412 Apr 14 15:52:14 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 228/684] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:52:13 2023] POST /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:52:14 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:52:14 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=12 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:52:14 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-825b2d7e-503d-44bb-bee4-af5386b2d1c3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:52:14 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-825b2d7e-503d-44bb-bee4-af5386b2d1c3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:52:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-825b2d7e-503d-44bb-bee4-af5386b2d1c3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-825b2d7e-503d-44bb-bee4-af5386b2d1c3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-825b2d7e-503d-44bb-bee4-af5386b2d1c3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-825b2d7e-503d-44bb-bee4-af5386b2d1c3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-825b2d7e-503d-44bb-bee4-af5386b2d1c3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-825b2d7e-503d-44bb-bee4-af5386b2d1c3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:14 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-825b2d7e-503d-44bb-bee4-af5386b2d1c3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:52:14 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-825b2d7e-503d-44bb-bee4-af5386b2d1c3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 200 len: 1663 microversion: 2.1 time: 0.329879 Apr 14 15:52:14 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 228/685] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:52:14 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 1663 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:52:14 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-ce6928d5-0af3-499c-b8c1-c451a2849f49 req-62bb5cb7-0ea6-4306-a580-eb1ccabb785b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-unplugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:52:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-ce6928d5-0af3-499c-b8c1-c451a2849f49 req-62bb5cb7-0ea6-4306-a580-eb1ccabb785b service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-ce6928d5-0af3-499c-b8c1-c451a2849f49 req-62bb5cb7-0ea6-4306-a580-eb1ccabb785b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-ce6928d5-0af3-499c-b8c1-c451a2849f49 req-62bb5cb7-0ea6-4306-a580-eb1ccabb785b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:14 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-ce6928d5-0af3-499c-b8c1-c451a2849f49 req-62bb5cb7-0ea6-4306-a580-eb1ccabb785b service nova] Creating event network-vif-unplugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:52:14 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-ce6928d5-0af3-499c-b8c1-c451a2849f49 req-62bb5cb7-0ea6-4306-a580-eb1ccabb785b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032945 Apr 14 15:52:14 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 230/686] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:52:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:52:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-plugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}, {"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-plugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}, {"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-plugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}, {"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-unplugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}, {"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-plugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:52:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:16 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-eedcf229-a498-4d3b-906e-6299e1c518ba tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:52:16 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-eedcf229-a498-4d3b-906e-6299e1c518ba tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:52:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Creating event network-vif-plugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:52:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Creating event network-vif-plugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:52:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-eedcf229-a498-4d3b-906e-6299e1c518ba tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Creating event network-vif-plugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:52:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-eedcf229-a498-4d3b-906e-6299e1c518ba tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Creating event network-vif-unplugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:52:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-eedcf229-a498-4d3b-906e-6299e1c518ba tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Creating event network-vif-plugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:52:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-eedcf229-a498-4d3b-906e-6299e1c518ba tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-eedcf229-a498-4d3b-906e-6299e1c518ba tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-eedcf229-a498-4d3b-906e-6299e1c518ba tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.042009 Apr 14 15:52:16 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 229/687] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:52:16 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:52:16 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-eedcf229-a498-4d3b-906e-6299e1c518ba tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045881 Apr 14 15:52:16 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 229/688] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:52:16 2023] GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 14 15:52:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-1fa3fd37-63fa-451d-a38d-b916793ab3f9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:52:16 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-1fa3fd37-63fa-451d-a38d-b916793ab3f9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:52:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1fa3fd37-63fa-451d-a38d-b916793ab3f9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1fa3fd37-63fa-451d-a38d-b916793ab3f9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1fa3fd37-63fa-451d-a38d-b916793ab3f9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1fa3fd37-63fa-451d-a38d-b916793ab3f9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1fa3fd37-63fa-451d-a38d-b916793ab3f9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1fa3fd37-63fa-451d-a38d-b916793ab3f9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:16 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-1fa3fd37-63fa-451d-a38d-b916793ab3f9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] HTTP exception thrown: Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 is not attached to volume f18d7393-5cf4-497c-bbe8-b261afa4cfb4 Apr 14 15:52:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-1fa3fd37-63fa-451d-a38d-b916793ab3f9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Request method failure captured: Apr 14 15:52:16 user devstack@n-api.service[61876]: request: DELETE /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/os-volume_attachments/f18d7393-5cf4-497c-bbe8-b261afa4cfb4 HTTP/1.1 Apr 14 15:52:16 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:52:16 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:52:16 user devstack@n-api.service[61876]: Connection: close Apr 14 15:52:16 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:52:16 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:52:16 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:52:16 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:52:16 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXQfuRe5Mx84pROzOPxXeB-PImcZqKH5R_6m5AwP3qCwwe0KmwOb4TFi8y6SMuALTDcSTknRD1fri0QgjYfA6wpM3bXvPSZBB6hPCxoBzTLpQY2P1GzJ7jp7ivNmM-vc9faSmLpkqMW80qGNJRDohvFywVJlTvOwoteimMsLFvejs-M Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Project-Id: 6d21cbc9fcc74fdd8579bad00a8ba2eb Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Project-Name: tempest-TestMinimumBasicScenario-554859149 Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d21cbc9fcc74fdd8579bad00a8ba2eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d21cbc9fcc74fdd8579bad00a8ba2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d21cbc9fcc74fdd8579bad00a8ba2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Tenant: tempest-TestMinimumBasicScenario-554859149 Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Tenant-Id: 6d21cbc9fcc74fdd8579bad00a8ba2eb Apr 14 15:52:16 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-TestMinimumBasicScenario-554859149 Apr 14 15:52:16 user devstack@n-api.service[61876]: X-User: tempest-TestMinimumBasicScenario-554859149-project-member Apr 14 15:52:16 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:52:16 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:52:16 user devstack@n-api.service[61876]: X-User-Id: 4e5d615d61ea4b1dafa4207d7b21e2d5 Apr 14 15:52:16 user devstack@n-api.service[61876]: X-User-Name: tempest-TestMinimumBasicScenario-554859149-project-member Apr 14 15:52:16 user devstack@n-api.service[61876]: method: > Apr 14 15:52:16 user devstack@n-api.service[61876]: exception: Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 is not attached to volume f18d7393-5cf4-497c-bbe8-b261afa4cfb4 Apr 14 15:52:16 user devstack@n-api.service[61876]: action_args: {'server_id': '9b7be2de-22e0-4639-ae89-856b4cfb17b4', 'id': 'f18d7393-5cf4-497c-bbe8-b261afa4cfb4'} Apr 14 15:52:16 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f18d7393-5cf4-497c-bbe8-b261afa4cfb4. Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 is not attached to volume f18d7393-5cf4-497c-bbe8-b261afa4cfb4 Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 is not attached to volume f18d7393-5cf4-497c-bbe8-b261afa4cfb4 Apr 14 15:52:16 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:52:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-1fa3fd37-63fa-451d-a38d-b916793ab3f9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Returning 404 to user: Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 is not attached to volume f18d7393-5cf4-497c-bbe8-b261afa4cfb4 {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:52:16 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-1fa3fd37-63fa-451d-a38d-b916793ab3f9 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/os-volume_attachments/f18d7393-5cf4-497c-bbe8-b261afa4cfb4" status: 404 len: 154 microversion: 2.1 time: 0.093866 Apr 14 15:52:16 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 231/689] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:52:16 2023] DELETE /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4/os-volume_attachments/f18d7393-5cf4-497c-bbe8-b261afa4cfb4 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:52:23 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:52:23 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:52:23 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:23 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:23 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:23 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:23 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:23 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:23 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:52:23 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4" status: 204 len: 0 microversion: 2.1 time: 0.113535 Apr 14 15:52:23 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 230/690] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:52:23 2023] DELETE /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:52:23 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-22aac6bc-f374-4643-8e8f-ae1425fa859f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:52:23 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-22aac6bc-f374-4643-8e8f-ae1425fa859f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:52:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-22aac6bc-f374-4643-8e8f-ae1425fa859f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-22aac6bc-f374-4643-8e8f-ae1425fa859f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-22aac6bc-f374-4643-8e8f-ae1425fa859f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-22aac6bc-f374-4643-8e8f-ae1425fa859f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-22aac6bc-f374-4643-8e8f-ae1425fa859f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-22aac6bc-f374-4643-8e8f-ae1425fa859f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:23 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-22aac6bc-f374-4643-8e8f-ae1425fa859f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:52:23 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-22aac6bc-f374-4643-8e8f-ae1425fa859f tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4" status: 200 len: 1543 microversion: 2.1 time: 0.247315 Apr 14 15:52:23 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 230/691] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:52:23 2023] GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4 => generated 1543 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:52:23 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-d9f4b506-e036-4db6-9240-9f431b4d8717 req-026befb8-0428-4234-8bc3-bff54ab55322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "name": "network-vif-unplugged", "status": "completed", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:52:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d9f4b506-e036-4db6-9240-9f431b4d8717 req-026befb8-0428-4234-8bc3-bff54ab55322 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d9f4b506-e036-4db6-9240-9f431b4d8717 req-026befb8-0428-4234-8bc3-bff54ab55322 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d9f4b506-e036-4db6-9240-9f431b4d8717 req-026befb8-0428-4234-8bc3-bff54ab55322 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d9f4b506-e036-4db6-9240-9f431b4d8717 req-026befb8-0428-4234-8bc3-bff54ab55322 service nova] Creating event network-vif-unplugged:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:52:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-d9f4b506-e036-4db6-9240-9f431b4d8717 req-026befb8-0428-4234-8bc3-bff54ab55322 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082367 Apr 14 15:52:23 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 232/692] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:52:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:52:24 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-a465fe85-eda1-4cfa-bbe3-d167bda0b7fb req-91e2291b-fafa-4a0e-af6e-50b9aa37c4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "name": "network-vif-deleted", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:52:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a465fe85-eda1-4cfa-bbe3-d167bda0b7fb req-91e2291b-fafa-4a0e-af6e-50b9aa37c4e2 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a465fe85-eda1-4cfa-bbe3-d167bda0b7fb req-91e2291b-fafa-4a0e-af6e-50b9aa37c4e2 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a465fe85-eda1-4cfa-bbe3-d167bda0b7fb req-91e2291b-fafa-4a0e-af6e-50b9aa37c4e2 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-a465fe85-eda1-4cfa-bbe3-d167bda0b7fb req-91e2291b-fafa-4a0e-af6e-50b9aa37c4e2 service nova] Creating event network-vif-deleted:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:52:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-a465fe85-eda1-4cfa-bbe3-d167bda0b7fb req-91e2291b-fafa-4a0e-af6e-50b9aa37c4e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035917 Apr 14 15:52:24 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 231/693] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:52:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:52:25 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-421c51c5-c7e7-4690-82b6-1abe811f9478 req-119f43c4-5b7f-44fa-8c8c-3301e4a99dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7be2de-22e0-4639-ae89-856b4cfb17b4", "name": "network-vif-plugged", "status": "completed", "tag": "70eb36b4-9ffc-491e-aed2-56587d2d6d47"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:52:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-421c51c5-c7e7-4690-82b6-1abe811f9478 req-119f43c4-5b7f-44fa-8c8c-3301e4a99dea service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-421c51c5-c7e7-4690-82b6-1abe811f9478 req-119f43c4-5b7f-44fa-8c8c-3301e4a99dea service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-421c51c5-c7e7-4690-82b6-1abe811f9478 req-119f43c4-5b7f-44fa-8c8c-3301e4a99dea service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-421c51c5-c7e7-4690-82b6-1abe811f9478 req-119f43c4-5b7f-44fa-8c8c-3301e4a99dea service nova] Creating event network-vif-plugged:70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 on user Apr 14 15:52:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-421c51c5-c7e7-4690-82b6-1abe811f9478 req-119f43c4-5b7f-44fa-8c8c-3301e4a99dea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030069 Apr 14 15:52:25 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 231/694] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:52:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:52:27 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-270558ee-fc5e-4479-8ca2-f81e7d077ccb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:52:27 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-270558ee-fc5e-4479-8ca2-f81e7d077ccb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:52:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-270558ee-fc5e-4479-8ca2-f81e7d077ccb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-270558ee-fc5e-4479-8ca2-f81e7d077ccb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-270558ee-fc5e-4479-8ca2-f81e7d077ccb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-270558ee-fc5e-4479-8ca2-f81e7d077ccb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-270558ee-fc5e-4479-8ca2-f81e7d077ccb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-270558ee-fc5e-4479-8ca2-f81e7d077ccb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:27 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-270558ee-fc5e-4479-8ca2-f81e7d077ccb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:52:27 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-270558ee-fc5e-4479-8ca2-f81e7d077ccb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1722 microversion: 2.1 time: 0.228811 Apr 14 15:52:27 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 233/695] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:52:27 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:52:40 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:52:40 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:52:40 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:52:40 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:52:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb/action" status: 202 len: 0 microversion: 2.87 time: 0.091353 Apr 14 15:52:40 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 232/696] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 15:52:40 2023] POST /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:52:40 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-317290c3-42d6-4cc9-bf40-57f5d675d665 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:52:40 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-317290c3-42d6-4cc9-bf40-57f5d675d665 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:52:40 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=8 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:52:40 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=20 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:52:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-317290c3-42d6-4cc9-bf40-57f5d675d665 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-317290c3-42d6-4cc9-bf40-57f5d675d665 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-317290c3-42d6-4cc9-bf40-57f5d675d665 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-317290c3-42d6-4cc9-bf40-57f5d675d665 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-317290c3-42d6-4cc9-bf40-57f5d675d665 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-317290c3-42d6-4cc9-bf40-57f5d675d665 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:40 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-317290c3-42d6-4cc9-bf40-57f5d675d665 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:52:40 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-317290c3-42d6-4cc9-bf40-57f5d675d665 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:52:40 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-317290c3-42d6-4cc9-bf40-57f5d675d665 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:52:40 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-317290c3-42d6-4cc9-bf40-57f5d675d665 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb" status: 200 len: 1762 microversion: 2.87 time: 0.234642 Apr 14 15:52:40 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 232/697] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:52:40 2023] GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb => generated 1762 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:52:41 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=10 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:52:41 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:52:41 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-aa2458af-1a85-41e3-a14c-13505e997074 req-f945d240-c21e-4aa5-81e8-038e1c8e4e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-unplugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:52:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-aa2458af-1a85-41e3-a14c-13505e997074 req-f945d240-c21e-4aa5-81e8-038e1c8e4e04 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-aa2458af-1a85-41e3-a14c-13505e997074 req-f945d240-c21e-4aa5-81e8-038e1c8e4e04 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-aa2458af-1a85-41e3-a14c-13505e997074 req-f945d240-c21e-4aa5-81e8-038e1c8e4e04 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-aa2458af-1a85-41e3-a14c-13505e997074 req-f945d240-c21e-4aa5-81e8-038e1c8e4e04 service nova] Creating event network-vif-unplugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:52:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-aa2458af-1a85-41e3-a14c-13505e997074 req-f945d240-c21e-4aa5-81e8-038e1c8e4e04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101797 Apr 14 15:52:41 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 234/698] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:52:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:52:42 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a156d026-b424-4dd3-95d8-4d1e60bf9fbb tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:52:42 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a156d026-b424-4dd3-95d8-4d1e60bf9fbb tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:52:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a156d026-b424-4dd3-95d8-4d1e60bf9fbb tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a156d026-b424-4dd3-95d8-4d1e60bf9fbb tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a156d026-b424-4dd3-95d8-4d1e60bf9fbb tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a156d026-b424-4dd3-95d8-4d1e60bf9fbb tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a156d026-b424-4dd3-95d8-4d1e60bf9fbb tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a156d026-b424-4dd3-95d8-4d1e60bf9fbb tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:42 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-a156d026-b424-4dd3-95d8-4d1e60bf9fbb tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] HTTP exception thrown: Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 could not be found. Apr 14 15:52:42 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a156d026-b424-4dd3-95d8-4d1e60bf9fbb tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Request method failure captured: Apr 14 15:52:42 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 HTTP/1.1 Apr 14 15:52:42 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:52:42 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:52:42 user devstack@n-api.service[61875]: Connection: close Apr 14 15:52:42 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:52:42 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:52:42 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:52:42 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:52:42 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXMKxzbBhP_wAtg_GdyJNNrWMR04NHs8zgKICtljO-nO6YTCpgo2vyufA6TA9obkNQP1BDx8dqjHFzo_6wx95XvZIjeEaJUUrM_1TVkjKaYmi4C7vK-xA49gMl_SHFlLmsp5h9mS72_mB06A8lcnKv1B72X0XrCUIHCQChJFUCLD5SA Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Project-Id: 609ac7b149e14baab270d83a2646fbdf Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Tenant-Id: 609ac7b149e14baab270d83a2646fbdf Apr 14 15:52:42 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:52:42 user devstack@n-api.service[61875]: X-User: tempest-ServerRescueNegativeTestJSON-1174024196-project-member Apr 14 15:52:42 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:52:42 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:52:42 user devstack@n-api.service[61875]: X-User-Id: 3fa924fefda1428d81152fd573540f26 Apr 14 15:52:42 user devstack@n-api.service[61875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1174024196-project-member Apr 14 15:52:42 user devstack@n-api.service[61875]: method: > Apr 14 15:52:42 user devstack@n-api.service[61875]: exception: Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 could not be found. Apr 14 15:52:42 user devstack@n-api.service[61875]: action_args: {'id': 'f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72'} Apr 14 15:52:42 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 could not be found. Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 could not be found. Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 could not be found. Apr 14 15:52:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:52:42 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a156d026-b424-4dd3-95d8-4d1e60bf9fbb tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Returning 404 to user: Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:52:42 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a156d026-b424-4dd3-95d8-4d1e60bf9fbb tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" status: 404 len: 111 microversion: 2.1 time: 0.028884 Apr 14 15:52:42 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 233/699] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:52:42 2023] GET /compute/v2.1/servers/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:52:42 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-9f121486-80d9-4d91-972b-14b44280ffca tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '.version_select at 0x7f29708732e0>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:52:42 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-9f121486-80d9-4d91-972b-14b44280ffca tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069158824" status: 202 len: 0 microversion: 2.1 time: 0.021451 Apr 14 15:52:42 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 233/700] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 15:52:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069158824 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:52:43 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-plugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}, {"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-plugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}, {"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-plugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}, {"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-unplugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}, {"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-plugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}, {"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-plugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:52:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:43 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Creating event network-vif-plugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:52:43 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Creating event network-vif-plugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:52:43 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Creating event network-vif-plugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:52:43 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Creating event network-vif-unplugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:52:43 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Creating event network-vif-plugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:52:43 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Creating event network-vif-plugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:52:43 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.034395 Apr 14 15:52:43 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 235/701] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:52:43 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:52:45 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-0cbf2301-23e0-4945-935c-7a651fe33239 req-bf1b0c6d-28b2-48ea-b15a-34f83e1f1de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-plugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:52:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0cbf2301-23e0-4945-935c-7a651fe33239 req-bf1b0c6d-28b2-48ea-b15a-34f83e1f1de1 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0cbf2301-23e0-4945-935c-7a651fe33239 req-bf1b0c6d-28b2-48ea-b15a-34f83e1f1de1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0cbf2301-23e0-4945-935c-7a651fe33239 req-bf1b0c6d-28b2-48ea-b15a-34f83e1f1de1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:45 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-0cbf2301-23e0-4945-935c-7a651fe33239 req-bf1b0c6d-28b2-48ea-b15a-34f83e1f1de1 service nova] Creating event network-vif-plugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:52:45 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-0cbf2301-23e0-4945-935c-7a651fe33239 req-bf1b0c6d-28b2-48ea-b15a-34f83e1f1de1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033996 Apr 14 15:52:45 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 234/702] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:52:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:52:50 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:52:50 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:52:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:50 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:52:50 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c" status: 204 len: 0 microversion: 2.1 time: 0.126727 Apr 14 15:52:50 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 234/703] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:52:50 2023] DELETE /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:52:50 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-1e680b8c-6f97-4e98-9b34-9ae8539df262 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:52:50 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-1e680b8c-6f97-4e98-9b34-9ae8539df262 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:52:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1e680b8c-6f97-4e98-9b34-9ae8539df262 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1e680b8c-6f97-4e98-9b34-9ae8539df262 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1e680b8c-6f97-4e98-9b34-9ae8539df262 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1e680b8c-6f97-4e98-9b34-9ae8539df262 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1e680b8c-6f97-4e98-9b34-9ae8539df262 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:50 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1e680b8c-6f97-4e98-9b34-9ae8539df262 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:50 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-1e680b8c-6f97-4e98-9b34-9ae8539df262 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:52:50 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-1e680b8c-6f97-4e98-9b34-9ae8539df262 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c" status: 200 len: 1495 microversion: 2.1 time: 0.291614 Apr 14 15:52:50 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 236/704] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:52:50 2023] GET /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c => generated 1495 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:52:50 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-e5b1b95e-d911-4fd8-947f-cfadac80a047 req-300fb90c-9280-4495-8a24-fd1f50771363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b5c2de-9cb2-4bcc-a04a-a4924e51151c", "name": "network-vif-unplugged", "status": "completed", "tag": "7d184083-9af2-4aad-abc5-7d9c28804ee1"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:52:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-e5b1b95e-d911-4fd8-947f-cfadac80a047 req-300fb90c-9280-4495-8a24-fd1f50771363 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-e5b1b95e-d911-4fd8-947f-cfadac80a047 req-300fb90c-9280-4495-8a24-fd1f50771363 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-e5b1b95e-d911-4fd8-947f-cfadac80a047 req-300fb90c-9280-4495-8a24-fd1f50771363 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:50 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-e5b1b95e-d911-4fd8-947f-cfadac80a047 req-300fb90c-9280-4495-8a24-fd1f50771363 service nova] Creating event network-vif-unplugged:7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c on user Apr 14 15:52:50 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-e5b1b95e-d911-4fd8-947f-cfadac80a047 req-300fb90c-9280-4495-8a24-fd1f50771363 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037756 Apr 14 15:52:50 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 235/705] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:52:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:52:52 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-6315134f-b087-4828-8e01-e83fb3bf5d8b req-4e94cd09-7c20-402f-acb3-817fd25d781a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b5c2de-9cb2-4bcc-a04a-a4924e51151c", "name": "network-vif-deleted", "tag": "7d184083-9af2-4aad-abc5-7d9c28804ee1"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:52:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6315134f-b087-4828-8e01-e83fb3bf5d8b req-4e94cd09-7c20-402f-acb3-817fd25d781a service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6315134f-b087-4828-8e01-e83fb3bf5d8b req-4e94cd09-7c20-402f-acb3-817fd25d781a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6315134f-b087-4828-8e01-e83fb3bf5d8b req-4e94cd09-7c20-402f-acb3-817fd25d781a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:52 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-6315134f-b087-4828-8e01-e83fb3bf5d8b req-4e94cd09-7c20-402f-acb3-817fd25d781a service nova] Creating event network-vif-deleted:7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c on user Apr 14 15:52:52 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-6315134f-b087-4828-8e01-e83fb3bf5d8b req-4e94cd09-7c20-402f-acb3-817fd25d781a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030910 Apr 14 15:52:52 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 235/706] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:52:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:52:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-0b74aa96-61b4-4208-859e-1ad8ed84248e req-8d65bfc8-b334-4807-8806-891868e00041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b5c2de-9cb2-4bcc-a04a-a4924e51151c", "name": "network-vif-plugged", "status": "completed", "tag": "7d184083-9af2-4aad-abc5-7d9c28804ee1"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:52:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-0b74aa96-61b4-4208-859e-1ad8ed84248e req-8d65bfc8-b334-4807-8806-891868e00041 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:52:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-0b74aa96-61b4-4208-859e-1ad8ed84248e req-8d65bfc8-b334-4807-8806-891868e00041 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:52:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-0b74aa96-61b4-4208-859e-1ad8ed84248e req-8d65bfc8-b334-4807-8806-891868e00041 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:52:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-0b74aa96-61b4-4208-859e-1ad8ed84248e req-8d65bfc8-b334-4807-8806-891868e00041 service nova] Creating event network-vif-plugged:7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c on user Apr 14 15:52:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-0b74aa96-61b4-4208-859e-1ad8ed84248e req-8d65bfc8-b334-4807-8806-891868e00041 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033369 Apr 14 15:52:52 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 237/707] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:52:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:53:04 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=8 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:04 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:04 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a4b4b5ee-26c5-413b-bd9a-67e6f4f1fb60 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:53:04 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a4b4b5ee-26c5-413b-bd9a-67e6f4f1fb60 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:53:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a4b4b5ee-26c5-413b-bd9a-67e6f4f1fb60 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a4b4b5ee-26c5-413b-bd9a-67e6f4f1fb60 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a4b4b5ee-26c5-413b-bd9a-67e6f4f1fb60 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a4b4b5ee-26c5-413b-bd9a-67e6f4f1fb60 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a4b4b5ee-26c5-413b-bd9a-67e6f4f1fb60 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a4b4b5ee-26c5-413b-bd9a-67e6f4f1fb60 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:04 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-a4b4b5ee-26c5-413b-bd9a-67e6f4f1fb60 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:53:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a4b4b5ee-26c5-413b-bd9a-67e6f4f1fb60 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 200 len: 1640 microversion: 2.1 time: 0.315765 Apr 14 15:53:04 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 236/708] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:53:04 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 1640 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:53:13 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:13 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:13 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-07891ffd-aa41-4845-9a7a-e6d5a209c183 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:53:13 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-07891ffd-aa41-4845-9a7a-e6d5a209c183 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:53:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-07891ffd-aa41-4845-9a7a-e6d5a209c183 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-07891ffd-aa41-4845-9a7a-e6d5a209c183 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-07891ffd-aa41-4845-9a7a-e6d5a209c183 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-07891ffd-aa41-4845-9a7a-e6d5a209c183 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-07891ffd-aa41-4845-9a7a-e6d5a209c183 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-07891ffd-aa41-4845-9a7a-e6d5a209c183 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:13 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-07891ffd-aa41-4845-9a7a-e6d5a209c183 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] HTTP exception thrown: Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 could not be found. Apr 14 15:53:13 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-07891ffd-aa41-4845-9a7a-e6d5a209c183 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Request method failure captured: Apr 14 15:53:13 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4 HTTP/1.1 Apr 14 15:53:13 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:53:13 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:53:13 user devstack@n-api.service[61874]: Connection: close Apr 14 15:53:13 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:53:13 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:53:13 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:53:13 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:53:13 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXQfuRe5Mx84pROzOPxXeB-PImcZqKH5R_6m5AwP3qCwwe0KmwOb4TFi8y6SMuALTDcSTknRD1fri0QgjYfA6wpM3bXvPSZBB6hPCxoBzTLpQY2P1GzJ7jp7ivNmM-vc9faSmLpkqMW80qGNJRDohvFywVJlTvOwoteimMsLFvejs-M Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Project-Id: 6d21cbc9fcc74fdd8579bad00a8ba2eb Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Project-Name: tempest-TestMinimumBasicScenario-554859149 Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d21cbc9fcc74fdd8579bad00a8ba2eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d21cbc9fcc74fdd8579bad00a8ba2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d21cbc9fcc74fdd8579bad00a8ba2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Tenant: tempest-TestMinimumBasicScenario-554859149 Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Tenant-Id: 6d21cbc9fcc74fdd8579bad00a8ba2eb Apr 14 15:53:13 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-TestMinimumBasicScenario-554859149 Apr 14 15:53:13 user devstack@n-api.service[61874]: X-User: tempest-TestMinimumBasicScenario-554859149-project-member Apr 14 15:53:13 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:53:13 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:53:13 user devstack@n-api.service[61874]: X-User-Id: 4e5d615d61ea4b1dafa4207d7b21e2d5 Apr 14 15:53:13 user devstack@n-api.service[61874]: X-User-Name: tempest-TestMinimumBasicScenario-554859149-project-member Apr 14 15:53:13 user devstack@n-api.service[61874]: method: > Apr 14 15:53:13 user devstack@n-api.service[61874]: exception: Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 could not be found. Apr 14 15:53:13 user devstack@n-api.service[61874]: action_args: {'id': '9b7be2de-22e0-4639-ae89-856b4cfb17b4'} Apr 14 15:53:13 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 could not be found. Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 could not be found. Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 could not be found. Apr 14 15:53:13 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:53:13 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-07891ffd-aa41-4845-9a7a-e6d5a209c183 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Returning 404 to user: Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:53:13 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-07891ffd-aa41-4845-9a7a-e6d5a209c183 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4" status: 404 len: 111 microversion: 2.1 time: 0.035759 Apr 14 15:53:13 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 236/709] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:53:13 2023] GET /compute/v2.1/servers/9b7be2de-22e0-4639-ae89-856b4cfb17b4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:53:13 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:13 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=12 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:13 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5d03aa08-0b8e-4c58-a373-e91f1481ce0e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Calling method '.version_select at 0x7f29707309d0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:53:13 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5d03aa08-0b8e-4c58-a373-e91f1481ce0e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1135265511" status: 202 len: 0 microversion: 2.1 time: 0.028354 Apr 14 15:53:13 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 238/710] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 15:53:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1135265511 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:53:27 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-7e5b3882-37c0-41bf-8008-179d36941cf9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:53:27 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-7e5b3882-37c0-41bf-8008-179d36941cf9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:53:27 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:27 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:27 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7e5b3882-37c0-41bf-8008-179d36941cf9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:27 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7e5b3882-37c0-41bf-8008-179d36941cf9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:27 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7e5b3882-37c0-41bf-8008-179d36941cf9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:27 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7e5b3882-37c0-41bf-8008-179d36941cf9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:27 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7e5b3882-37c0-41bf-8008-179d36941cf9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:27 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7e5b3882-37c0-41bf-8008-179d36941cf9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:27 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-7e5b3882-37c0-41bf-8008-179d36941cf9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:53:27 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-7e5b3882-37c0-41bf-8008-179d36941cf9 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1722 microversion: 2.1 time: 0.256349 Apr 14 15:53:27 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 237/711] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:53:27 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:53:27 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-636d75f0-a679-420b-b34d-95ebe03371cb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:53:27 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-636d75f0-a679-420b-b34d-95ebe03371cb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:53:27 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:27 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-636d75f0-a679-420b-b34d-95ebe03371cb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-636d75f0-a679-420b-b34d-95ebe03371cb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-636d75f0-a679-420b-b34d-95ebe03371cb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-636d75f0-a679-420b-b34d-95ebe03371cb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-636d75f0-a679-420b-b34d-95ebe03371cb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-636d75f0-a679-420b-b34d-95ebe03371cb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:28 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-636d75f0-a679-420b-b34d-95ebe03371cb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:53:28 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-636d75f0-a679-420b-b34d-95ebe03371cb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1722 microversion: 2.1 time: 0.430985 Apr 14 15:53:28 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 237/712] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:53:27 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1722 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:53:30 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-4a35fdc8-9a00-400d-b7e3-6e38eface179 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:53:31 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-4a35fdc8-9a00-400d-b7e3-6e38eface179 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:53:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4a35fdc8-9a00-400d-b7e3-6e38eface179 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4a35fdc8-9a00-400d-b7e3-6e38eface179 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4a35fdc8-9a00-400d-b7e3-6e38eface179 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4a35fdc8-9a00-400d-b7e3-6e38eface179 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4a35fdc8-9a00-400d-b7e3-6e38eface179 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4a35fdc8-9a00-400d-b7e3-6e38eface179 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:31 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-4a35fdc8-9a00-400d-b7e3-6e38eface179 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:53:31 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-4a35fdc8-9a00-400d-b7e3-6e38eface179 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:53:31 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-4a35fdc8-9a00-400d-b7e3-6e38eface179 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:53:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-4a35fdc8-9a00-400d-b7e3-6e38eface179 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb" status: 200 len: 1768 microversion: 2.87 time: 0.498065 Apr 14 15:53:31 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 239/713] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:53:30 2023] GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb => generated 1768 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:53:40 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:40 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:40 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-0be08ec9-743a-459a-8a07-d73830a8e096 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:53:40 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-0be08ec9-743a-459a-8a07-d73830a8e096 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:53:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0be08ec9-743a-459a-8a07-d73830a8e096 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0be08ec9-743a-459a-8a07-d73830a8e096 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0be08ec9-743a-459a-8a07-d73830a8e096 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0be08ec9-743a-459a-8a07-d73830a8e096 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0be08ec9-743a-459a-8a07-d73830a8e096 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-0be08ec9-743a-459a-8a07-d73830a8e096 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-0be08ec9-743a-459a-8a07-d73830a8e096 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] HTTP exception thrown: Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c could not be found. Apr 14 15:53:40 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-0be08ec9-743a-459a-8a07-d73830a8e096 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Request method failure captured: Apr 14 15:53:40 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c HTTP/1.1 Apr 14 15:53:40 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:53:40 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:53:40 user devstack@n-api.service[61875]: Connection: close Apr 14 15:53:40 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:53:40 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:53:40 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:53:40 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:53:40 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXMKxzbBhP_wAtg_GdyJNNrWMR04NHs8zgKICtljO-nO6YTCpgo2vyufA6TA9obkNQP1BDx8dqjHFzo_6wx95XvZIjeEaJUUrM_1TVkjKaYmi4C7vK-xA49gMl_SHFlLmsp5h9mS72_mB06A8lcnKv1B72X0XrCUIHCQChJFUCLD5SA Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Project-Id: 609ac7b149e14baab270d83a2646fbdf Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Tenant-Id: 609ac7b149e14baab270d83a2646fbdf Apr 14 15:53:40 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:53:40 user devstack@n-api.service[61875]: X-User: tempest-ServerRescueNegativeTestJSON-1174024196-project-member Apr 14 15:53:40 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:53:40 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:53:40 user devstack@n-api.service[61875]: X-User-Id: 3fa924fefda1428d81152fd573540f26 Apr 14 15:53:40 user devstack@n-api.service[61875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1174024196-project-member Apr 14 15:53:40 user devstack@n-api.service[61875]: method: > Apr 14 15:53:40 user devstack@n-api.service[61875]: exception: Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c could not be found. Apr 14 15:53:40 user devstack@n-api.service[61875]: action_args: {'id': '40b5c2de-9cb2-4bcc-a04a-a4924e51151c'} Apr 14 15:53:40 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c could not be found. Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c could not be found. Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c could not be found. Apr 14 15:53:40 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:53:40 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-0be08ec9-743a-459a-8a07-d73830a8e096 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Returning 404 to user: Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:53:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-0be08ec9-743a-459a-8a07-d73830a8e096 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c" status: 404 len: 111 microversion: 2.1 time: 0.226730 Apr 14 15:53:40 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 238/714] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:53:40 2023] GET /compute/v2.1/servers/40b5c2de-9cb2-4bcc-a04a-a4924e51151c => generated 111 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:53:40 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:53:40 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:53:40 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:40 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:53:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:40 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:53:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4" status: 204 len: 0 microversion: 2.1 time: 0.166131 Apr 14 15:53:41 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 238/715] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:53:40 2023] DELETE /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:53:41 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5b3ea527-98ab-4c15-9c88-df51ce9289dc tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:53:41 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-5b3ea527-98ab-4c15-9c88-df51ce9289dc tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:53:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b3ea527-98ab-4c15-9c88-df51ce9289dc tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b3ea527-98ab-4c15-9c88-df51ce9289dc tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b3ea527-98ab-4c15-9c88-df51ce9289dc tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b3ea527-98ab-4c15-9c88-df51ce9289dc tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b3ea527-98ab-4c15-9c88-df51ce9289dc tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b3ea527-98ab-4c15-9c88-df51ce9289dc tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:41 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-5b3ea527-98ab-4c15-9c88-df51ce9289dc tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:53:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5b3ea527-98ab-4c15-9c88-df51ce9289dc tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4" status: 200 len: 1508 microversion: 2.1 time: 0.237361 Apr 14 15:53:41 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 240/716] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:53:41 2023] GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4 => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:53:41 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-400789c4-5fb8-4e1e-806e-f6eeb81fd347 req-233a24b7-6ec3-4022-8c55-3983afa06ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "name": "network-vif-unplugged", "status": "completed", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:53:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-400789c4-5fb8-4e1e-806e-f6eeb81fd347 req-233a24b7-6ec3-4022-8c55-3983afa06ab9 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-400789c4-5fb8-4e1e-806e-f6eeb81fd347 req-233a24b7-6ec3-4022-8c55-3983afa06ab9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-400789c4-5fb8-4e1e-806e-f6eeb81fd347 req-233a24b7-6ec3-4022-8c55-3983afa06ab9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:41 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-400789c4-5fb8-4e1e-806e-f6eeb81fd347 req-233a24b7-6ec3-4022-8c55-3983afa06ab9 service nova] Creating event network-vif-unplugged:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:53:41 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-400789c4-5fb8-4e1e-806e-f6eeb81fd347 req-233a24b7-6ec3-4022-8c55-3983afa06ab9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030492 Apr 14 15:53:41 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 239/717] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:53:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:53:43 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "name": "network-vif-plugged", "status": "completed", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}, {"server_uuid": "0f27f459-5b11-4564-ab4c-7194b18319f4", "name": "network-vif-deleted", "tag": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:53:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:53:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:53:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:53:43 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] Creating event network-vif-plugged:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:53:43 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] Creating event network-vif-deleted:e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance 0f27f459-5b11-4564-ab4c-7194b18319f4 on user Apr 14 15:53:43 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036189 Apr 14 15:53:43 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 239/718] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:53:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:54:04 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:04 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=12 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:04 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:54:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:04 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Going to try to start instance {{(pid=61876) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 15:54:04 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/action" status: 202 len: 0 microversion: 2.1 time: 0.113580 Apr 14 15:54:05 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 241/719] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:54:04 2023] POST /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:54:05 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:05 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:05 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-e6d4e423-f59c-469c-a1c5-0c7408b6dd8c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:54:05 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-e6d4e423-f59c-469c-a1c5-0c7408b6dd8c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:54:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e6d4e423-f59c-469c-a1c5-0c7408b6dd8c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e6d4e423-f59c-469c-a1c5-0c7408b6dd8c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e6d4e423-f59c-469c-a1c5-0c7408b6dd8c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e6d4e423-f59c-469c-a1c5-0c7408b6dd8c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e6d4e423-f59c-469c-a1c5-0c7408b6dd8c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e6d4e423-f59c-469c-a1c5-0c7408b6dd8c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:05 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-e6d4e423-f59c-469c-a1c5-0c7408b6dd8c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:54:05 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-e6d4e423-f59c-469c-a1c5-0c7408b6dd8c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 200 len: 1649 microversion: 2.1 time: 0.236285 Apr 14 15:54:05 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 240/720] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:54:05 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 1649 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:54:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:08 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-e1e58454-d141-40c3-bbd7-61255654233f req-98b36ba8-0faf-40fe-b055-7c0dcc78c455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-plugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:54:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-e1e58454-d141-40c3-bbd7-61255654233f req-98b36ba8-0faf-40fe-b055-7c0dcc78c455 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-e1e58454-d141-40c3-bbd7-61255654233f req-98b36ba8-0faf-40fe-b055-7c0dcc78c455 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-e1e58454-d141-40c3-bbd7-61255654233f req-98b36ba8-0faf-40fe-b055-7c0dcc78c455 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:08 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-e1e58454-d141-40c3-bbd7-61255654233f req-98b36ba8-0faf-40fe-b055-7c0dcc78c455 service nova] Creating event network-vif-plugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:54:08 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-e1e58454-d141-40c3-bbd7-61255654233f req-98b36ba8-0faf-40fe-b055-7c0dcc78c455 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148284 Apr 14 15:54:08 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 240/721] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:54:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:54:10 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-ba45ba7d-e984-4371-b163-d0eb70eddc2c req-e5fddd3f-8cf5-4e3b-83e0-70db55e2b055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-plugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:54:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-ba45ba7d-e984-4371-b163-d0eb70eddc2c req-e5fddd3f-8cf5-4e3b-83e0-70db55e2b055 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-ba45ba7d-e984-4371-b163-d0eb70eddc2c req-e5fddd3f-8cf5-4e3b-83e0-70db55e2b055 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-ba45ba7d-e984-4371-b163-d0eb70eddc2c req-e5fddd3f-8cf5-4e3b-83e0-70db55e2b055 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-ba45ba7d-e984-4371-b163-d0eb70eddc2c req-e5fddd3f-8cf5-4e3b-83e0-70db55e2b055 service nova] Creating event network-vif-plugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:54:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-ba45ba7d-e984-4371-b163-d0eb70eddc2c req-e5fddd3f-8cf5-4e3b-83e0-70db55e2b055 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034121 Apr 14 15:54:10 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 242/722] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:54:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:54:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:54:28 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:54:28 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:28 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:28 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:54:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 204 len: 0 microversion: 2.1 time: 0.157537 Apr 14 15:54:28 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 241/723] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:54:28 2023] DELETE /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:54:28 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:28 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:28 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-cae1ffc9-3a82-442c-bd52-62ef0a645968 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:54:28 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-cae1ffc9-3a82-442c-bd52-62ef0a645968 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:54:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cae1ffc9-3a82-442c-bd52-62ef0a645968 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cae1ffc9-3a82-442c-bd52-62ef0a645968 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cae1ffc9-3a82-442c-bd52-62ef0a645968 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cae1ffc9-3a82-442c-bd52-62ef0a645968 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cae1ffc9-3a82-442c-bd52-62ef0a645968 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cae1ffc9-3a82-442c-bd52-62ef0a645968 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:28 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-cae1ffc9-3a82-442c-bd52-62ef0a645968 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:54:28 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-cae1ffc9-3a82-442c-bd52-62ef0a645968 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 200 len: 1728 microversion: 2.1 time: 0.354897 Apr 14 15:54:28 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 241/724] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:54:28 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 1728 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:54:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-4efa165d-1583-4870-a745-1da7e31228e4 req-189f474d-78e6-4937-a176-14a89ee4464c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-unplugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:54:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-4efa165d-1583-4870-a745-1da7e31228e4 req-189f474d-78e6-4937-a176-14a89ee4464c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-4efa165d-1583-4870-a745-1da7e31228e4 req-189f474d-78e6-4937-a176-14a89ee4464c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-4efa165d-1583-4870-a745-1da7e31228e4 req-189f474d-78e6-4937-a176-14a89ee4464c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-4efa165d-1583-4870-a745-1da7e31228e4 req-189f474d-78e6-4937-a176-14a89ee4464c service nova] Creating event network-vif-unplugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:54:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-4efa165d-1583-4870-a745-1da7e31228e4 req-189f474d-78e6-4937-a176-14a89ee4464c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038855 Apr 14 15:54:28 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 243/725] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:54:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:54:30 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-557e8901-a528-43a5-abe6-b9f2c3d46296 req-ea1f9787-7018-4776-9cf5-0b2f253fa577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-deleted", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:54:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-557e8901-a528-43a5-abe6-b9f2c3d46296 req-ea1f9787-7018-4776-9cf5-0b2f253fa577 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-557e8901-a528-43a5-abe6-b9f2c3d46296 req-ea1f9787-7018-4776-9cf5-0b2f253fa577 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:30 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-557e8901-a528-43a5-abe6-b9f2c3d46296 req-ea1f9787-7018-4776-9cf5-0b2f253fa577 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:30 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-557e8901-a528-43a5-abe6-b9f2c3d46296 req-ea1f9787-7018-4776-9cf5-0b2f253fa577 service nova] Creating event network-vif-deleted:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:54:30 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-557e8901-a528-43a5-abe6-b9f2c3d46296 req-ea1f9787-7018-4776-9cf5-0b2f253fa577 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029369 Apr 14 15:54:30 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 242/726] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:54:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:54:30 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-6b0c35b8-e82d-47a1-96c7-bcd94aa5225f req-cc34e246-f0c8-4335-9353-a13f9331b83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd224b68-1cc6-48cc-bcfe-a1ce40252e65", "name": "network-vif-plugged", "status": "completed", "tag": "f5a1caf6-baf3-4c27-82c9-aab287c07447"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:54:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6b0c35b8-e82d-47a1-96c7-bcd94aa5225f req-cc34e246-f0c8-4335-9353-a13f9331b83c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6b0c35b8-e82d-47a1-96c7-bcd94aa5225f req-cc34e246-f0c8-4335-9353-a13f9331b83c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6b0c35b8-e82d-47a1-96c7-bcd94aa5225f req-cc34e246-f0c8-4335-9353-a13f9331b83c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-6b0c35b8-e82d-47a1-96c7-bcd94aa5225f req-cc34e246-f0c8-4335-9353-a13f9331b83c service nova] Creating event network-vif-plugged:f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 on user Apr 14 15:54:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-6b0c35b8-e82d-47a1-96c7-bcd94aa5225f req-cc34e246-f0c8-4335-9353-a13f9331b83c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038261 Apr 14 15:54:30 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 242/727] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:54:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:54:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-81cebd48-dda0-493a-8da2-1c123755e6d6 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:54:31 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-81cebd48-dda0-493a-8da2-1c123755e6d6 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:54:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-81cebd48-dda0-493a-8da2-1c123755e6d6 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-81cebd48-dda0-493a-8da2-1c123755e6d6 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-81cebd48-dda0-493a-8da2-1c123755e6d6 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-81cebd48-dda0-493a-8da2-1c123755e6d6 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-81cebd48-dda0-493a-8da2-1c123755e6d6 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-81cebd48-dda0-493a-8da2-1c123755e6d6 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-81cebd48-dda0-493a-8da2-1c123755e6d6 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] HTTP exception thrown: Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 could not be found. Apr 14 15:54:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-81cebd48-dda0-493a-8da2-1c123755e6d6 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Request method failure captured: Apr 14 15:54:31 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4 HTTP/1.1 Apr 14 15:54:31 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:54:31 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:54:31 user devstack@n-api.service[61876]: Connection: close Apr 14 15:54:31 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:54:31 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:54:31 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:54:31 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:54:31 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXMKxzbBhP_wAtg_GdyJNNrWMR04NHs8zgKICtljO-nO6YTCpgo2vyufA6TA9obkNQP1BDx8dqjHFzo_6wx95XvZIjeEaJUUrM_1TVkjKaYmi4C7vK-xA49gMl_SHFlLmsp5h9mS72_mB06A8lcnKv1B72X0XrCUIHCQChJFUCLD5SA Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Project-Id: 609ac7b149e14baab270d83a2646fbdf Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/609ac7b149e14baab270d83a2646fbdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Tenant-Id: 609ac7b149e14baab270d83a2646fbdf Apr 14 15:54:31 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1174024196 Apr 14 15:54:31 user devstack@n-api.service[61876]: X-User: tempest-ServerRescueNegativeTestJSON-1174024196-project-member Apr 14 15:54:31 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:54:31 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:54:31 user devstack@n-api.service[61876]: X-User-Id: 3fa924fefda1428d81152fd573540f26 Apr 14 15:54:31 user devstack@n-api.service[61876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1174024196-project-member Apr 14 15:54:31 user devstack@n-api.service[61876]: method: > Apr 14 15:54:31 user devstack@n-api.service[61876]: exception: Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 could not be found. Apr 14 15:54:31 user devstack@n-api.service[61876]: action_args: {'id': '0f27f459-5b11-4564-ab4c-7194b18319f4'} Apr 14 15:54:31 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 could not be found. Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 could not be found. Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 could not be found. Apr 14 15:54:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:54:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-81cebd48-dda0-493a-8da2-1c123755e6d6 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Returning 404 to user: Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:54:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-81cebd48-dda0-493a-8da2-1c123755e6d6 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4" status: 404 len: 111 microversion: 2.1 time: 0.029786 Apr 14 15:54:31 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 244/728] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:54:31 2023] GET /compute/v2.1/servers/0f27f459-5b11-4564-ab4c-7194b18319f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:54:31 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:54:31 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:54:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:31 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:54:31 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb" status: 204 len: 0 microversion: 2.87 time: 0.128536 Apr 14 15:54:31 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 243/729] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 15:54:31 2023] DELETE /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 15:54:31 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-8d3c1334-4c5e-4556-9e73-db3e828e1315 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:54:31 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-8d3c1334-4c5e-4556-9e73-db3e828e1315 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:54:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8d3c1334-4c5e-4556-9e73-db3e828e1315 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8d3c1334-4c5e-4556-9e73-db3e828e1315 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8d3c1334-4c5e-4556-9e73-db3e828e1315 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8d3c1334-4c5e-4556-9e73-db3e828e1315 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8d3c1334-4c5e-4556-9e73-db3e828e1315 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-8d3c1334-4c5e-4556-9e73-db3e828e1315 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:31 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-8d3c1334-4c5e-4556-9e73-db3e828e1315 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:54:31 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-8d3c1334-4c5e-4556-9e73-db3e828e1315 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:54:31 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-8d3c1334-4c5e-4556-9e73-db3e828e1315 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:54:31 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-8d3c1334-4c5e-4556-9e73-db3e828e1315 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb" status: 200 len: 1774 microversion: 2.87 time: 0.281520 Apr 14 15:54:31 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 243/730] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:54:31 2023] GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb => generated 1774 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:54:32 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-unplugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}, {"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-plugged", "status": "completed", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:54:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:32 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] Creating event network-vif-unplugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:54:32 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] Creating event network-vif-plugged:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:54:32 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.047411 Apr 14 15:54:32 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 245/731] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:54:32 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:54:34 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-47bf1f1f-a540-4aae-88d8-291def56bd14 req-235fb3fb-3fca-4900-80cb-6bc3c10faabb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0514ed4d-d911-4d2a-b1eb-8373e72894eb", "name": "network-vif-deleted", "tag": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:54:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-47bf1f1f-a540-4aae-88d8-291def56bd14 req-235fb3fb-3fca-4900-80cb-6bc3c10faabb service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-47bf1f1f-a540-4aae-88d8-291def56bd14 req-235fb3fb-3fca-4900-80cb-6bc3c10faabb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-47bf1f1f-a540-4aae-88d8-291def56bd14 req-235fb3fb-3fca-4900-80cb-6bc3c10faabb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:34 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-47bf1f1f-a540-4aae-88d8-291def56bd14 req-235fb3fb-3fca-4900-80cb-6bc3c10faabb service nova] Creating event network-vif-deleted:6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb on user Apr 14 15:54:34 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-47bf1f1f-a540-4aae-88d8-291def56bd14 req-235fb3fb-3fca-4900-80cb-6bc3c10faabb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043937 Apr 14 15:54:34 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 244/732] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:54:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:54:55 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-960c9fe7-0e54-4965-bc69-e8ac4ddebe8f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:54:55 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-960c9fe7-0e54-4965-bc69-e8ac4ddebe8f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:54:55 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=14 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:55 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=8 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:54:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-960c9fe7-0e54-4965-bc69-e8ac4ddebe8f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-960c9fe7-0e54-4965-bc69-e8ac4ddebe8f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-960c9fe7-0e54-4965-bc69-e8ac4ddebe8f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-960c9fe7-0e54-4965-bc69-e8ac4ddebe8f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:54:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-960c9fe7-0e54-4965-bc69-e8ac4ddebe8f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:54:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-960c9fe7-0e54-4965-bc69-e8ac4ddebe8f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:54:55 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-960c9fe7-0e54-4965-bc69-e8ac4ddebe8f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:54:55 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-960c9fe7-0e54-4965-bc69-e8ac4ddebe8f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 200 len: 1653 microversion: 2.1 time: 0.261570 Apr 14 15:54:55 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 244/733] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:54:55 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 1653 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:55:18 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:18 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:18 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-31042886-a508-4348-9860-09e6b8fff0f1 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:55:18 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-31042886-a508-4348-9860-09e6b8fff0f1 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:55:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-31042886-a508-4348-9860-09e6b8fff0f1 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-31042886-a508-4348-9860-09e6b8fff0f1 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-31042886-a508-4348-9860-09e6b8fff0f1 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-31042886-a508-4348-9860-09e6b8fff0f1 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-31042886-a508-4348-9860-09e6b8fff0f1 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-31042886-a508-4348-9860-09e6b8fff0f1 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:18 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-31042886-a508-4348-9860-09e6b8fff0f1 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HTTP exception thrown: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:18 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-31042886-a508-4348-9860-09e6b8fff0f1 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Request method failure captured: Apr 14 15:55:18 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 HTTP/1.1 Apr 14 15:55:18 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:55:18 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:55:18 user devstack@n-api.service[61876]: Connection: close Apr 14 15:55:18 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:55:18 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:55:18 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:55:18 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:55:18 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXQCThpy3yl6l1TCWVl5qU9ObX9ml7vxjJ1brRtAPkbr5ZkdoJQff6z6UDjK5Q28yasEVG9HXQzHH37jgV5YNAsEJoMKFqOHBJp644GvPOnwDCBB71n3Hhn9EBLtM10HjdAX1t1mFB8pYmFsnraSY0KDD3eoZp0nTUBMTr6jHRO65Nw Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Project-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Project-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/95e26fa4727e46479d108fe49e225706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Tenant: tempest-ServerActionsTestJSON-649148824 Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Tenant-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 15:55:18 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 15:55:18 user devstack@n-api.service[61876]: X-User: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 15:55:18 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:55:18 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:55:18 user devstack@n-api.service[61876]: X-User-Id: 3062186c340a4cfe875d5455b0ace246 Apr 14 15:55:18 user devstack@n-api.service[61876]: X-User-Name: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 15:55:18 user devstack@n-api.service[61876]: method: > Apr 14 15:55:18 user devstack@n-api.service[61876]: exception: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:18 user devstack@n-api.service[61876]: action_args: {'id': 'fd224b68-1cc6-48cc-bcfe-a1ce40252e65'} Apr 14 15:55:18 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:18 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:55:18 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-31042886-a508-4348-9860-09e6b8fff0f1 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Returning 404 to user: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:55:18 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-31042886-a508-4348-9860-09e6b8fff0f1 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 404 len: 111 microversion: 2.1 time: 0.033981 Apr 14 15:55:18 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 246/734] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:55:18 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:55:18 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-78d262c0-d99f-4343-9c95-b5bbd145b180 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:55:18 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-78d262c0-d99f-4343-9c95-b5bbd145b180 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:55:18 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:18 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-78d262c0-d99f-4343-9c95-b5bbd145b180 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-78d262c0-d99f-4343-9c95-b5bbd145b180 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-78d262c0-d99f-4343-9c95-b5bbd145b180 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-78d262c0-d99f-4343-9c95-b5bbd145b180 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-78d262c0-d99f-4343-9c95-b5bbd145b180 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-78d262c0-d99f-4343-9c95-b5bbd145b180 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:18 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-78d262c0-d99f-4343-9c95-b5bbd145b180 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HTTP exception thrown: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:18 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-78d262c0-d99f-4343-9c95-b5bbd145b180 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Request method failure captured: Apr 14 15:55:18 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-volume_attachments HTTP/1.1 Apr 14 15:55:18 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:55:18 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:55:18 user devstack@n-api.service[61875]: Connection: close Apr 14 15:55:18 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:55:18 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:55:18 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:55:18 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:55:18 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXQCThpy3yl6l1TCWVl5qU9ObX9ml7vxjJ1brRtAPkbr5ZkdoJQff6z6UDjK5Q28yasEVG9HXQzHH37jgV5YNAsEJoMKFqOHBJp644GvPOnwDCBB71n3Hhn9EBLtM10HjdAX1t1mFB8pYmFsnraSY0KDD3eoZp0nTUBMTr6jHRO65Nw Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Project-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Project-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/95e26fa4727e46479d108fe49e225706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Tenant: tempest-ServerActionsTestJSON-649148824 Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Tenant-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 15:55:18 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 15:55:18 user devstack@n-api.service[61875]: X-User: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 15:55:18 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:55:18 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:55:18 user devstack@n-api.service[61875]: X-User-Id: 3062186c340a4cfe875d5455b0ace246 Apr 14 15:55:18 user devstack@n-api.service[61875]: X-User-Name: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 15:55:18 user devstack@n-api.service[61875]: method: > Apr 14 15:55:18 user devstack@n-api.service[61875]: exception: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:18 user devstack@n-api.service[61875]: action_args: {'server_id': 'fd224b68-1cc6-48cc-bcfe-a1ce40252e65'} Apr 14 15:55:18 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:18 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:55:18 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-78d262c0-d99f-4343-9c95-b5bbd145b180 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Returning 404 to user: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:55:18 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-78d262c0-d99f-4343-9c95-b5bbd145b180 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041344 Apr 14 15:55:18 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 245/735] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:55:18 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:55:19 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-a18dad4a-9c2f-4b83-a1ea-323c1ab1d6cd tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:55:19 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-a18dad4a-9c2f-4b83-a1ea-323c1ab1d6cd tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:55:19 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:19 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a18dad4a-9c2f-4b83-a1ea-323c1ab1d6cd tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a18dad4a-9c2f-4b83-a1ea-323c1ab1d6cd tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a18dad4a-9c2f-4b83-a1ea-323c1ab1d6cd tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a18dad4a-9c2f-4b83-a1ea-323c1ab1d6cd tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a18dad4a-9c2f-4b83-a1ea-323c1ab1d6cd tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a18dad4a-9c2f-4b83-a1ea-323c1ab1d6cd tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:19 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-a18dad4a-9c2f-4b83-a1ea-323c1ab1d6cd tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HTTP exception thrown: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:19 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-a18dad4a-9c2f-4b83-a1ea-323c1ab1d6cd tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Request method failure captured: Apr 14 15:55:19 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 HTTP/1.1 Apr 14 15:55:19 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:55:19 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:55:19 user devstack@n-api.service[61874]: Connection: close Apr 14 15:55:19 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:55:19 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:55:19 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:55:19 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:55:19 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXQCThpy3yl6l1TCWVl5qU9ObX9ml7vxjJ1brRtAPkbr5ZkdoJQff6z6UDjK5Q28yasEVG9HXQzHH37jgV5YNAsEJoMKFqOHBJp644GvPOnwDCBB71n3Hhn9EBLtM10HjdAX1t1mFB8pYmFsnraSY0KDD3eoZp0nTUBMTr6jHRO65Nw Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Project-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Project-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/95e26fa4727e46479d108fe49e225706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Tenant: tempest-ServerActionsTestJSON-649148824 Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Tenant-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 15:55:19 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 15:55:19 user devstack@n-api.service[61874]: X-User: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 15:55:19 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:55:19 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:55:19 user devstack@n-api.service[61874]: X-User-Id: 3062186c340a4cfe875d5455b0ace246 Apr 14 15:55:19 user devstack@n-api.service[61874]: X-User-Name: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 15:55:19 user devstack@n-api.service[61874]: method: > Apr 14 15:55:19 user devstack@n-api.service[61874]: exception: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:19 user devstack@n-api.service[61874]: action_args: {'id': 'fd224b68-1cc6-48cc-bcfe-a1ce40252e65'} Apr 14 15:55:19 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 15:55:19 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:55:19 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-a18dad4a-9c2f-4b83-a1ea-323c1ab1d6cd tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Returning 404 to user: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:55:19 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-a18dad4a-9c2f-4b83-a1ea-323c1ab1d6cd tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 404 len: 111 microversion: 2.1 time: 0.032264 Apr 14 15:55:19 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 245/736] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:55:19 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-162942861", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "b5636fab-ff0a-4313-afb7-6f7fa779e363"}], "security_groups": [{"name": "tempest-securitygroup--448801128"}], "key_name": "tempest-keypair-2131359708", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] validate_networks() for [('b5636fab-ff0a-4313-afb7-6f7fa779e363', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for project 95e26fa4727e46479d108fe49e225706. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for user 3062186c340a4cfe875d5455b0ace246 and project 95e26fa4727e46479d108fe49e225706. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:55:19 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:55:19 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.809107 Apr 14 15:55:19 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 247/737] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:55:19 2023] POST /compute/v2.1/servers => generated 403 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:55:19 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-16d6c659-a6ae-4a61-9003-4987aa08cfa3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:55:19 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-16d6c659-a6ae-4a61-9003-4987aa08cfa3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:55:20 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-16d6c659-a6ae-4a61-9003-4987aa08cfa3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:55:20 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-16d6c659-a6ae-4a61-9003-4987aa08cfa3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110" status: 200 len: 1232 microversion: 2.1 time: 0.073864 Apr 14 15:55:20 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 246/738] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:55:19 2023] GET /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110 => generated 1232 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:55:21 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4bba1b75-2957-4d63-8f01-b7091a5bddf2 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:55:21 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-4bba1b75-2957-4d63-8f01-b7091a5bddf2 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:55:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4bba1b75-2957-4d63-8f01-b7091a5bddf2 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4bba1b75-2957-4d63-8f01-b7091a5bddf2 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4bba1b75-2957-4d63-8f01-b7091a5bddf2 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4bba1b75-2957-4d63-8f01-b7091a5bddf2 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4bba1b75-2957-4d63-8f01-b7091a5bddf2 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:21 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4bba1b75-2957-4d63-8f01-b7091a5bddf2 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:21 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-4bba1b75-2957-4d63-8f01-b7091a5bddf2 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] HTTP exception thrown: Instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb could not be found. Apr 14 15:55:21 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4bba1b75-2957-4d63-8f01-b7091a5bddf2 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Request method failure captured: Apr 14 15:55:21 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb HTTP/1.1 Apr 14 15:55:21 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:55:21 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:55:21 user devstack@n-api.service[61874]: Connection: close Apr 14 15:55:21 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:55:21 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:55:21 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:55:21 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:55:21 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXMADDE-NwjnZp9tW6I-ow3ZVfqszgqfHI_8rUrEc0ahvwDf5YlB1FwQtPLwOODY0crV9knzZMCW1xm607j0R2F6BLfBnzFR0ca57rAqIXziDpwarj4S20EX-3O7Do0bFRZFs3IE_uyZfLVMB5sjuaHDz4eYfDz2AuF9lbEBPA5m7iY Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Project-Id: 584a53650c014f87b9622f2011996200 Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-756745587 Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/584a53650c014f87b9622f2011996200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/584a53650c014f87b9622f2011996200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/584a53650c014f87b9622f2011996200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-756745587 Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Tenant-Id: 584a53650c014f87b9622f2011996200 Apr 14 15:55:21 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-756745587 Apr 14 15:55:21 user devstack@n-api.service[61874]: X-User: tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member Apr 14 15:55:21 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:55:21 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:55:21 user devstack@n-api.service[61874]: X-User-Id: efb645d110464e7e85d7c955ee9f3466 Apr 14 15:55:21 user devstack@n-api.service[61874]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member Apr 14 15:55:21 user devstack@n-api.service[61874]: method: > Apr 14 15:55:21 user devstack@n-api.service[61874]: exception: Instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb could not be found. Apr 14 15:55:21 user devstack@n-api.service[61874]: action_args: {'id': '0514ed4d-d911-4d2a-b1eb-8373e72894eb'} Apr 14 15:55:21 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb could not be found. Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb could not be found. Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb could not be found. Apr 14 15:55:21 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:55:21 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4bba1b75-2957-4d63-8f01-b7091a5bddf2 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Returning 404 to user: Instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:55:21 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-4bba1b75-2957-4d63-8f01-b7091a5bddf2 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb" status: 404 len: 111 microversion: 2.87 time: 0.038005 Apr 14 15:55:21 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 246/739] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:55:21 2023] GET /compute/v2.1/servers/0514ed4d-d911-4d2a-b1eb-8373e72894eb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:55:22 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:55:22 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:55:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:22 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Going to try to terminate instance {{(pid=61876) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:55:22 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583" status: 204 len: 0 microversion: 2.87 time: 0.112071 Apr 14 15:55:22 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 248/740] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 15:55:22 2023] DELETE /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 15:55:22 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-21db680d-8a21-448f-afcf-22aec080d2d8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:55:22 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-21db680d-8a21-448f-afcf-22aec080d2d8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:55:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-21db680d-8a21-448f-afcf-22aec080d2d8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-21db680d-8a21-448f-afcf-22aec080d2d8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-21db680d-8a21-448f-afcf-22aec080d2d8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-21db680d-8a21-448f-afcf-22aec080d2d8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-21db680d-8a21-448f-afcf-22aec080d2d8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-21db680d-8a21-448f-afcf-22aec080d2d8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:22 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-0a8a5df6-a6f2-489c-b8b8-ef23ddd01cc5 req-7ff3821a-139c-4bdb-8ccf-8de37f0e6d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5542b8-ac5f-40a6-bbff-8a2734a01583", "name": "network-vif-unplugged", "status": "completed", "tag": "cd9b8743-1e76-4694-91d4-4420b8e16ce2"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0a8a5df6-a6f2-489c-b8b8-ef23ddd01cc5 req-7ff3821a-139c-4bdb-8ccf-8de37f0e6d47 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0a8a5df6-a6f2-489c-b8b8-ef23ddd01cc5 req-7ff3821a-139c-4bdb-8ccf-8de37f0e6d47 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0a8a5df6-a6f2-489c-b8b8-ef23ddd01cc5 req-7ff3821a-139c-4bdb-8ccf-8de37f0e6d47 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:22 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-0a8a5df6-a6f2-489c-b8b8-ef23ddd01cc5 req-7ff3821a-139c-4bdb-8ccf-8de37f0e6d47 service nova] Creating event network-vif-unplugged:cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 on user Apr 14 15:55:22 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-0a8a5df6-a6f2-489c-b8b8-ef23ddd01cc5 req-7ff3821a-139c-4bdb-8ccf-8de37f0e6d47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032791 Apr 14 15:55:22 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 247/741] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:55:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:55:22 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-21db680d-8a21-448f-afcf-22aec080d2d8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:55:22 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-21db680d-8a21-448f-afcf-22aec080d2d8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:55:22 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-21db680d-8a21-448f-afcf-22aec080d2d8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:55:22 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-21db680d-8a21-448f-afcf-22aec080d2d8 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583" status: 200 len: 1697 microversion: 2.87 time: 0.610713 Apr 14 15:55:22 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 247/742] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:55:22 2023] GET /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583 => generated 1697 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:55:22 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0fcb3f5-6676-43a8-b6e2-2da51d195110", "tag": "e3e86dec-e3bf-4584-8918-eb5d22e8428a"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] Creating event network-changed:e3e86dec-e3bf-4584-8918-eb5d22e8428a for instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 on user Apr 14 15:55:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037559 Apr 14 15:55:23 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 249/743] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:55:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:55:24 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5542b8-ac5f-40a6-bbff-8a2734a01583", "name": "network-vif-plugged", "status": "completed", "tag": "cd9b8743-1e76-4694-91d4-4420b8e16ce2"}, {"server_uuid": "ae5542b8-ac5f-40a6-bbff-8a2734a01583", "name": "network-vif-plugged", "status": "completed", "tag": "cd9b8743-1e76-4694-91d4-4420b8e16ce2"}, {"server_uuid": "ae5542b8-ac5f-40a6-bbff-8a2734a01583", "name": "network-vif-plugged", "status": "completed", "tag": "cd9b8743-1e76-4694-91d4-4420b8e16ce2"}, {"server_uuid": "ae5542b8-ac5f-40a6-bbff-8a2734a01583", "name": "network-vif-unplugged", "status": "completed", "tag": "cd9b8743-1e76-4694-91d4-4420b8e16ce2"}, {"server_uuid": "ae5542b8-ac5f-40a6-bbff-8a2734a01583", "name": "network-vif-plugged", "status": "completed", "tag": "cd9b8743-1e76-4694-91d4-4420b8e16ce2"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:24 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Creating event network-vif-plugged:cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 on user Apr 14 15:55:24 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Creating event network-vif-plugged:cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 on user Apr 14 15:55:24 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Creating event network-vif-plugged:cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 on user Apr 14 15:55:24 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Creating event network-vif-unplugged:cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 on user Apr 14 15:55:24 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Creating event network-vif-plugged:cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 on user Apr 14 15:55:24 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.030604 Apr 14 15:55:24 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 248/744] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:55:24 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:55:25 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-389a2cdb-ae5d-4769-bc86-8f11c7cf35e4 req-2c3de141-6d72-4053-b500-89be803e70ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5542b8-ac5f-40a6-bbff-8a2734a01583", "name": "network-vif-deleted", "tag": "cd9b8743-1e76-4694-91d4-4420b8e16ce2"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-389a2cdb-ae5d-4769-bc86-8f11c7cf35e4 req-2c3de141-6d72-4053-b500-89be803e70ef service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-389a2cdb-ae5d-4769-bc86-8f11c7cf35e4 req-2c3de141-6d72-4053-b500-89be803e70ef service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-389a2cdb-ae5d-4769-bc86-8f11c7cf35e4 req-2c3de141-6d72-4053-b500-89be803e70ef service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-389a2cdb-ae5d-4769-bc86-8f11c7cf35e4 req-2c3de141-6d72-4053-b500-89be803e70ef service nova] Creating event network-vif-deleted:cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 on user Apr 14 15:55:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-389a2cdb-ae5d-4769-bc86-8f11c7cf35e4 req-2c3de141-6d72-4053-b500-89be803e70ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031055 Apr 14 15:55:25 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 248/745] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:55:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:55:25 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-004f46b6-1b31-43ff-8d6c-e64764405be3 req-393796d4-ee0b-435b-b77d-6e87442559d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0fcb3f5-6676-43a8-b6e2-2da51d195110", "name": "network-vif-plugged", "status": "completed", "tag": "e3e86dec-e3bf-4584-8918-eb5d22e8428a"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-004f46b6-1b31-43ff-8d6c-e64764405be3 req-393796d4-ee0b-435b-b77d-6e87442559d1 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-004f46b6-1b31-43ff-8d6c-e64764405be3 req-393796d4-ee0b-435b-b77d-6e87442559d1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-004f46b6-1b31-43ff-8d6c-e64764405be3 req-393796d4-ee0b-435b-b77d-6e87442559d1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-004f46b6-1b31-43ff-8d6c-e64764405be3 req-393796d4-ee0b-435b-b77d-6e87442559d1 service nova] Creating event network-vif-plugged:e3e86dec-e3bf-4584-8918-eb5d22e8428a for instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 on user Apr 14 15:55:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-004f46b6-1b31-43ff-8d6c-e64764405be3 req-393796d4-ee0b-435b-b77d-6e87442559d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030942 Apr 14 15:55:25 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 250/746] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:55:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1548416193", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] validate_networks() for None {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Getting quotas for project 9b71f0ba039b408691746831d3ca9d91. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Getting quotas for user 324bd0e5d45b424fbf12bcf336f10894 and project 9b71f0ba039b408691746831d3ca9d91. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:55:26 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:55:26 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.413640 Apr 14 15:55:26 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 249/747] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:55:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:55:26 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-61036659-d625-4db7-bbaf-d92fc86ce1bd tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:55:26 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-61036659-d625-4db7-bbaf-d92fc86ce1bd tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:55:27 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-61036659-d625-4db7-bbaf-d92fc86ce1bd tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324bd0e5d45b424fbf12bcf336f10894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b71f0ba039b408691746831d3ca9d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:55:27 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-61036659-d625-4db7-bbaf-d92fc86ce1bd tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/885a9f3e-7deb-47e9-84df-8879ee0659a1" status: 200 len: 1209 microversion: 2.1 time: 0.062940 Apr 14 15:55:27 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 249/748] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:55:26 2023] GET /compute/v2.1/servers/885a9f3e-7deb-47e9-84df-8879ee0659a1 => generated 1209 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:55:27 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-100bc538-1725-44ca-9d23-c3cbda8d4534 req-09b8fbdb-63e9-40d2-8c30-0047ff17e808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0fcb3f5-6676-43a8-b6e2-2da51d195110", "name": "network-vif-plugged", "status": "completed", "tag": "e3e86dec-e3bf-4584-8918-eb5d22e8428a"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-100bc538-1725-44ca-9d23-c3cbda8d4534 req-09b8fbdb-63e9-40d2-8c30-0047ff17e808 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-100bc538-1725-44ca-9d23-c3cbda8d4534 req-09b8fbdb-63e9-40d2-8c30-0047ff17e808 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-100bc538-1725-44ca-9d23-c3cbda8d4534 req-09b8fbdb-63e9-40d2-8c30-0047ff17e808 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:27 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-100bc538-1725-44ca-9d23-c3cbda8d4534 req-09b8fbdb-63e9-40d2-8c30-0047ff17e808 service nova] Creating event network-vif-plugged:e3e86dec-e3bf-4584-8918-eb5d22e8428a for instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 on user Apr 14 15:55:27 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-100bc538-1725-44ca-9d23-c3cbda8d4534 req-09b8fbdb-63e9-40d2-8c30-0047ff17e808 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033126 Apr 14 15:55:27 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 251/749] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:55:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:55:30 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "885a9f3e-7deb-47e9-84df-8879ee0659a1", "tag": "1f437122-97ba-41e8-9d63-5d1686920360"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] Creating event network-changed:1f437122-97ba-41e8-9d63-5d1686920360 for instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 on user Apr 14 15:55:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039202 Apr 14 15:55:30 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 250/750] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:55:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:55:32 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-61d3ef0c-aa35-460b-bb6f-f01d5f752a7c req-9131c4f9-7e24-430d-8575-a214c384075f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "885a9f3e-7deb-47e9-84df-8879ee0659a1", "name": "network-vif-plugged", "status": "completed", "tag": "1f437122-97ba-41e8-9d63-5d1686920360"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-61d3ef0c-aa35-460b-bb6f-f01d5f752a7c req-9131c4f9-7e24-430d-8575-a214c384075f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-61d3ef0c-aa35-460b-bb6f-f01d5f752a7c req-9131c4f9-7e24-430d-8575-a214c384075f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-61d3ef0c-aa35-460b-bb6f-f01d5f752a7c req-9131c4f9-7e24-430d-8575-a214c384075f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-61d3ef0c-aa35-460b-bb6f-f01d5f752a7c req-9131c4f9-7e24-430d-8575-a214c384075f service nova] Creating event network-vif-plugged:1f437122-97ba-41e8-9d63-5d1686920360 for instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 on user Apr 14 15:55:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-61d3ef0c-aa35-460b-bb6f-f01d5f752a7c req-9131c4f9-7e24-430d-8575-a214c384075f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032744 Apr 14 15:55:32 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 250/751] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:55:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:55:34 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:34 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:34 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-a91e0d2b-3cce-498e-81e3-6eb93f806ec9 req-847a2da9-ea70-4063-a741-1732fc0e20ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "885a9f3e-7deb-47e9-84df-8879ee0659a1", "name": "network-vif-plugged", "status": "completed", "tag": "1f437122-97ba-41e8-9d63-5d1686920360"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a91e0d2b-3cce-498e-81e3-6eb93f806ec9 req-847a2da9-ea70-4063-a741-1732fc0e20ac service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a91e0d2b-3cce-498e-81e3-6eb93f806ec9 req-847a2da9-ea70-4063-a741-1732fc0e20ac service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a91e0d2b-3cce-498e-81e3-6eb93f806ec9 req-847a2da9-ea70-4063-a741-1732fc0e20ac service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-a91e0d2b-3cce-498e-81e3-6eb93f806ec9 req-847a2da9-ea70-4063-a741-1732fc0e20ac service nova] Creating event network-vif-plugged:1f437122-97ba-41e8-9d63-5d1686920360 for instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 on user Apr 14 15:55:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-a91e0d2b-3cce-498e-81e3-6eb93f806ec9 req-847a2da9-ea70-4063-a741-1732fc0e20ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042528 Apr 14 15:55:34 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 252/752] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:55:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:55:55 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:55 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:55 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:55 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=12 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:55 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-25d17c49-4094-4224-aff3-7f76d8c10f16 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:55:55 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-25d17c49-4094-4224-aff3-7f76d8c10f16 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:55:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-25d17c49-4094-4224-aff3-7f76d8c10f16 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-25d17c49-4094-4224-aff3-7f76d8c10f16 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-25d17c49-4094-4224-aff3-7f76d8c10f16 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-25d17c49-4094-4224-aff3-7f76d8c10f16 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-25d17c49-4094-4224-aff3-7f76d8c10f16 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-25d17c49-4094-4224-aff3-7f76d8c10f16 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:55 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-25d17c49-4094-4224-aff3-7f76d8c10f16 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048959 Apr 14 15:55:55 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 251/753] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:55:55 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:55:55 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:55 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=18 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:55 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=12 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:55 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:55:55 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:55:55 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:55 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:55 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:55 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:55 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:55 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:55 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:55:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 204 len: 0 microversion: 2.1 time: 0.118556 Apr 14 15:55:56 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 251/754] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:55:55 2023] DELETE /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:55:56 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:56 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:55:56 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-9a8a11c4-5e1d-4886-b500-d24551d99845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:55:56 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-9a8a11c4-5e1d-4886-b500-d24551d99845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:55:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9a8a11c4-5e1d-4886-b500-d24551d99845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9a8a11c4-5e1d-4886-b500-d24551d99845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9a8a11c4-5e1d-4886-b500-d24551d99845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9a8a11c4-5e1d-4886-b500-d24551d99845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9a8a11c4-5e1d-4886-b500-d24551d99845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9a8a11c4-5e1d-4886-b500-d24551d99845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:56 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-93cb80b6-6368-4981-9416-242ba756650e req-d232d0ed-129a-45f7-814b-6870ab5a026d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-unplugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:56 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-93cb80b6-6368-4981-9416-242ba756650e req-d232d0ed-129a-45f7-814b-6870ab5a026d service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:56 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-93cb80b6-6368-4981-9416-242ba756650e req-d232d0ed-129a-45f7-814b-6870ab5a026d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:56 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-93cb80b6-6368-4981-9416-242ba756650e req-d232d0ed-129a-45f7-814b-6870ab5a026d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:56 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-93cb80b6-6368-4981-9416-242ba756650e req-d232d0ed-129a-45f7-814b-6870ab5a026d service nova] Creating event network-vif-unplugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:55:56 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-93cb80b6-6368-4981-9416-242ba756650e req-d232d0ed-129a-45f7-814b-6870ab5a026d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032720 Apr 14 15:55:56 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 252/755] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:55:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:55:56 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-9a8a11c4-5e1d-4886-b500-d24551d99845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:55:56 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-9a8a11c4-5e1d-4886-b500-d24551d99845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 200 len: 1659 microversion: 2.1 time: 0.282305 Apr 14 15:55:56 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 253/756] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:55:56 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 1659 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 15:55:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-44df7fd2-034e-485d-9a9c-91a826eedab1 req-7bb93ec1-9877-4223-ad68-a21a69b5c7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-deleted", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:57 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-44df7fd2-034e-485d-9a9c-91a826eedab1 req-7bb93ec1-9877-4223-ad68-a21a69b5c7a7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:57 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-44df7fd2-034e-485d-9a9c-91a826eedab1 req-7bb93ec1-9877-4223-ad68-a21a69b5c7a7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:57 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-44df7fd2-034e-485d-9a9c-91a826eedab1 req-7bb93ec1-9877-4223-ad68-a21a69b5c7a7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-44df7fd2-034e-485d-9a9c-91a826eedab1 req-7bb93ec1-9877-4223-ad68-a21a69b5c7a7 service nova] Creating event network-vif-deleted:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:55:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-44df7fd2-034e-485d-9a9c-91a826eedab1 req-7bb93ec1-9877-4223-ad68-a21a69b5c7a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035192 Apr 14 15:55:57 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 252/757] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:55:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:55:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-0c6fac2c-c10a-410f-a354-1746d6e64cca req-3db08963-b470-42c7-b810-e8f240aa2591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297", "name": "network-vif-plugged", "status": "completed", "tag": "9a9bcd90-ba38-4399-9896-69b86979911f"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:55:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0c6fac2c-c10a-410f-a354-1746d6e64cca req-3db08963-b470-42c7-b810-e8f240aa2591 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:55:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0c6fac2c-c10a-410f-a354-1746d6e64cca req-3db08963-b470-42c7-b810-e8f240aa2591 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:55:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0c6fac2c-c10a-410f-a354-1746d6e64cca req-3db08963-b470-42c7-b810-e8f240aa2591 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:55:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-0c6fac2c-c10a-410f-a354-1746d6e64cca req-3db08963-b470-42c7-b810-e8f240aa2591 service nova] Creating event network-vif-plugged:9a9bcd90-ba38-4399-9896-69b86979911f for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 on user Apr 14 15:55:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-0c6fac2c-c10a-410f-a354-1746d6e64cca req-3db08963-b470-42c7-b810-e8f240aa2591 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031188 Apr 14 15:55:58 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 253/758] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:55:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:56:10 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-9ffca90c-3390-4243-8b76-be517ca485e2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:56:10 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-9ffca90c-3390-4243-8b76-be517ca485e2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:56:10 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:56:10 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:56:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9ffca90c-3390-4243-8b76-be517ca485e2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9ffca90c-3390-4243-8b76-be517ca485e2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9ffca90c-3390-4243-8b76-be517ca485e2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9ffca90c-3390-4243-8b76-be517ca485e2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9ffca90c-3390-4243-8b76-be517ca485e2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9ffca90c-3390-4243-8b76-be517ca485e2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:10 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-9ffca90c-3390-4243-8b76-be517ca485e2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:56:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-9ffca90c-3390-4243-8b76-be517ca485e2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110" status: 200 len: 1538 microversion: 2.1 time: 0.278455 Apr 14 15:56:10 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 254/759] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:56:10 2023] GET /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110 => generated 1538 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-545c26cc-d71e-475f-bd50-1440fef3ce30 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-545c26cc-d71e-475f-bd50-1440fef3ce30 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-545c26cc-d71e-475f-bd50-1440fef3ce30 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-545c26cc-d71e-475f-bd50-1440fef3ce30 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-545c26cc-d71e-475f-bd50-1440fef3ce30 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-545c26cc-d71e-475f-bd50-1440fef3ce30 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-545c26cc-d71e-475f-bd50-1440fef3ce30 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-545c26cc-d71e-475f-bd50-1440fef3ce30 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:13 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-545c26cc-d71e-475f-bd50-1440fef3ce30 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] HTTP exception thrown: Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 could not be found. Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-545c26cc-d71e-475f-bd50-1440fef3ce30 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Request method failure captured: Apr 14 15:56:13 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583 HTTP/1.1 Apr 14 15:56:13 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:56:13 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:56:13 user devstack@n-api.service[61875]: Connection: close Apr 14 15:56:13 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:56:13 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:56:13 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:56:13 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:56:13 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXMADDE-NwjnZp9tW6I-ow3ZVfqszgqfHI_8rUrEc0ahvwDf5YlB1FwQtPLwOODY0crV9knzZMCW1xm607j0R2F6BLfBnzFR0ca57rAqIXziDpwarj4S20EX-3O7Do0bFRZFs3IE_uyZfLVMB5sjuaHDz4eYfDz2AuF9lbEBPA5m7iY Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Project-Id: 584a53650c014f87b9622f2011996200 Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-756745587 Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/584a53650c014f87b9622f2011996200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/584a53650c014f87b9622f2011996200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/584a53650c014f87b9622f2011996200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-756745587 Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Tenant-Id: 584a53650c014f87b9622f2011996200 Apr 14 15:56:13 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-756745587 Apr 14 15:56:13 user devstack@n-api.service[61875]: X-User: tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member Apr 14 15:56:13 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:56:13 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:56:13 user devstack@n-api.service[61875]: X-User-Id: efb645d110464e7e85d7c955ee9f3466 Apr 14 15:56:13 user devstack@n-api.service[61875]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member Apr 14 15:56:13 user devstack@n-api.service[61875]: method: > Apr 14 15:56:13 user devstack@n-api.service[61875]: exception: Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 could not be found. Apr 14 15:56:13 user devstack@n-api.service[61875]: action_args: {'id': 'ae5542b8-ac5f-40a6-bbff-8a2734a01583'} Apr 14 15:56:13 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 could not be found. Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 could not be found. Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 could not be found. Apr 14 15:56:13 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-545c26cc-d71e-475f-bd50-1440fef3ce30 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Returning 404 to user: Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:56:13 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-545c26cc-d71e-475f-bd50-1440fef3ce30 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583" status: 404 len: 111 microversion: 2.87 time: 0.037773 Apr 14 15:56:13 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 253/760] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:56:13 2023] GET /compute/v2.1/servers/ae5542b8-ac5f-40a6-bbff-8a2734a01583 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:56:13 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:56:13 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=10 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:56:13 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:56:13 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:56:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:13 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:56:13 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" status: 204 len: 0 microversion: 2.87 time: 0.122846 Apr 14 15:56:13 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 254/761] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 15:56:13 2023] DELETE /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 15:56:13 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-096227ac-8b57-46f7-b432-23bebc9783cc tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:56:13 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-096227ac-8b57-46f7-b432-23bebc9783cc tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:56:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-096227ac-8b57-46f7-b432-23bebc9783cc tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-096227ac-8b57-46f7-b432-23bebc9783cc tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-096227ac-8b57-46f7-b432-23bebc9783cc tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-096227ac-8b57-46f7-b432-23bebc9783cc tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-096227ac-8b57-46f7-b432-23bebc9783cc tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-096227ac-8b57-46f7-b432-23bebc9783cc tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-5ee14a7f-210f-4d6e-96a2-2624d0aa3fca req-5d2ad52c-3e07-486d-b99e-bbbb926661b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-unplugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5ee14a7f-210f-4d6e-96a2-2624d0aa3fca req-5d2ad52c-3e07-486d-b99e-bbbb926661b4 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5ee14a7f-210f-4d6e-96a2-2624d0aa3fca req-5d2ad52c-3e07-486d-b99e-bbbb926661b4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5ee14a7f-210f-4d6e-96a2-2624d0aa3fca req-5d2ad52c-3e07-486d-b99e-bbbb926661b4 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:13 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-5ee14a7f-210f-4d6e-96a2-2624d0aa3fca req-5d2ad52c-3e07-486d-b99e-bbbb926661b4 service nova] Creating event network-vif-unplugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:56:13 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-096227ac-8b57-46f7-b432-23bebc9783cc tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:56:13 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-5ee14a7f-210f-4d6e-96a2-2624d0aa3fca req-5d2ad52c-3e07-486d-b99e-bbbb926661b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030360 Apr 14 15:56:13 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 254/762] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:56:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:56:13 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-096227ac-8b57-46f7-b432-23bebc9783cc tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:56:13 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-096227ac-8b57-46f7-b432-23bebc9783cc tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:56:13 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-096227ac-8b57-46f7-b432-23bebc9783cc tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" status: 200 len: 1774 microversion: 2.87 time: 0.249637 Apr 14 15:56:13 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 255/763] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:56:13 2023] GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => generated 1774 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:56:15 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-ead9a815-f668-47d1-b4a3-49fa01552e38 req-199e13d9-b82e-41d7-b4ee-f4f3f500d3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-deleted", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:56:15 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ead9a815-f668-47d1-b4a3-49fa01552e38 req-199e13d9-b82e-41d7-b4ee-f4f3f500d3c8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:15 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ead9a815-f668-47d1-b4a3-49fa01552e38 req-199e13d9-b82e-41d7-b4ee-f4f3f500d3c8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:15 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-ead9a815-f668-47d1-b4a3-49fa01552e38 req-199e13d9-b82e-41d7-b4ee-f4f3f500d3c8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:15 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-ead9a815-f668-47d1-b4a3-49fa01552e38 req-199e13d9-b82e-41d7-b4ee-f4f3f500d3c8 service nova] Creating event network-vif-deleted:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:56:15 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-ead9a815-f668-47d1-b4a3-49fa01552e38 req-199e13d9-b82e-41d7-b4ee-f4f3f500d3c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040991 Apr 14 15:56:15 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 255/764] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:56:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:56:15 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-eeadeef8-aea7-4ab9-a599-51c1c0813575 req-fcb1b695-3767-451a-8028-7b1b44f9ddf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3", "name": "network-vif-plugged", "status": "completed", "tag": "18973ac2-c226-4d12-98e7-5bbee348527a"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:56:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-eeadeef8-aea7-4ab9-a599-51c1c0813575 req-fcb1b695-3767-451a-8028-7b1b44f9ddf8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-eeadeef8-aea7-4ab9-a599-51c1c0813575 req-fcb1b695-3767-451a-8028-7b1b44f9ddf8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-eeadeef8-aea7-4ab9-a599-51c1c0813575 req-fcb1b695-3767-451a-8028-7b1b44f9ddf8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:15 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-eeadeef8-aea7-4ab9-a599-51c1c0813575 req-fcb1b695-3767-451a-8028-7b1b44f9ddf8 service nova] Creating event network-vif-plugged:18973ac2-c226-4d12-98e7-5bbee348527a for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 on user Apr 14 15:56:15 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-eeadeef8-aea7-4ab9-a599-51c1c0813575 req-fcb1b695-3767-451a-8028-7b1b44f9ddf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032265 Apr 14 15:56:15 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 255/765] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:56:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:56:17 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6929527a-bf1a-468e-977e-9db757b70a9e tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:56:17 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-6929527a-bf1a-468e-977e-9db757b70a9e tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:56:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6929527a-bf1a-468e-977e-9db757b70a9e tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6929527a-bf1a-468e-977e-9db757b70a9e tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6929527a-bf1a-468e-977e-9db757b70a9e tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6929527a-bf1a-468e-977e-9db757b70a9e tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6929527a-bf1a-468e-977e-9db757b70a9e tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6929527a-bf1a-468e-977e-9db757b70a9e tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:17 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-6929527a-bf1a-468e-977e-9db757b70a9e tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324bd0e5d45b424fbf12bcf336f10894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b71f0ba039b408691746831d3ca9d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:56:17 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6929527a-bf1a-468e-977e-9db757b70a9e tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/885a9f3e-7deb-47e9-84df-8879ee0659a1" status: 200 len: 1455 microversion: 2.1 time: 0.235080 Apr 14 15:56:17 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 256/766] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:56:17 2023] GET /compute/v2.1/servers/885a9f3e-7deb-47e9-84df-8879ee0659a1 => generated 1455 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:56:46 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:56:46 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:56:46 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-5195c12e-9917-4b5b-b859-2bab77955720 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:56:46 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-5195c12e-9917-4b5b-b859-2bab77955720 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:56:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5195c12e-9917-4b5b-b859-2bab77955720 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5195c12e-9917-4b5b-b859-2bab77955720 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5195c12e-9917-4b5b-b859-2bab77955720 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5195c12e-9917-4b5b-b859-2bab77955720 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5195c12e-9917-4b5b-b859-2bab77955720 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5195c12e-9917-4b5b-b859-2bab77955720 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:46 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-5195c12e-9917-4b5b-b859-2bab77955720 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] HTTP exception thrown: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 15:56:46 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-5195c12e-9917-4b5b-b859-2bab77955720 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Request method failure captured: Apr 14 15:56:46 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 HTTP/1.1 Apr 14 15:56:46 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:56:46 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:56:46 user devstack@n-api.service[61874]: Connection: close Apr 14 15:56:46 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:56:46 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:56:46 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:56:46 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:56:46 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXVP3UHGr2rvLXX6mutfrvTFZcLIKfEdCq92P5izsyNpLCIZfiEnYGqUZ1nd3slCZ3TlBFQ1dvyGPx-amw3QrdbAhCbhWZWqveaP1VkssQMrhXsrqXlHGZ4rGyTekPmLw3z1LXrY9TH8gT4FV_VlO1M0aIFrQtPQnbPR8FYXfym3OQs Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Project-Id: 534f0fb654694b079fa89150594e1bbb Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Project-Name: tempest-AttachVolumeTestJSON-1357089397 Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Tenant: tempest-AttachVolumeTestJSON-1357089397 Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Tenant-Id: 534f0fb654694b079fa89150594e1bbb Apr 14 15:56:46 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1357089397 Apr 14 15:56:46 user devstack@n-api.service[61874]: X-User: tempest-AttachVolumeTestJSON-1357089397-project-member Apr 14 15:56:46 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:56:46 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:56:46 user devstack@n-api.service[61874]: X-User-Id: b44feacbb8fa4680a965953c122cf31c Apr 14 15:56:46 user devstack@n-api.service[61874]: X-User-Name: tempest-AttachVolumeTestJSON-1357089397-project-member Apr 14 15:56:46 user devstack@n-api.service[61874]: method: > Apr 14 15:56:46 user devstack@n-api.service[61874]: exception: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 15:56:46 user devstack@n-api.service[61874]: action_args: {'id': 'd4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297'} Apr 14 15:56:46 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 15:56:46 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:56:46 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-5195c12e-9917-4b5b-b859-2bab77955720 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Returning 404 to user: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:56:46 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-5195c12e-9917-4b5b-b859-2bab77955720 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 404 len: 111 microversion: 2.1 time: 0.039524 Apr 14 15:56:46 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 256/767] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:56:46 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:56:46 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:56:46 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:56:46 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-cdbf4d99-0d9a-46c5-8264-e1fa80412e74 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '.version_select at 0x7f297087d120>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:56:46 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-cdbf4d99-0d9a-46c5-8264-e1fa80412e74 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-734921168" status: 202 len: 0 microversion: 2.1 time: 0.035099 Apr 14 15:56:46 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 256/768] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 15:56:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-734921168 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:56:47 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:56:47 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=18 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:56:47 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-7f3c9010-5d17-4f61-bf45-2b7685c79ab1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Action: 'create', calling method: .version_select at 0x7f2970732b00>, body: {"keypair": {"name": "tempest-keypair-421873860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCSIAZnoCiRJt45dD0E5xmyyO5lUzvHwlH61yOiQhj4V0wFze8eBEvT7uq5nZcn2ckoN5yUkVVbk6Kf8R6Y+l/LK1oIj6QOlmGmhgF/DWxteCk+8zo62LyLjQwqW9I5Gg=="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:56:47 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-7f3c9010-5d17-4f61-bf45-2b7685c79ab1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting quotas for project 534f0fb654694b079fa89150594e1bbb. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:56:47 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-7f3c9010-5d17-4f61-bf45-2b7685c79ab1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting quotas for user b44feacbb8fa4680a965953c122cf31c and project 534f0fb654694b079fa89150594e1bbb. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:56:47 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-7f3c9010-5d17-4f61-bf45-2b7685c79ab1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050761 Apr 14 15:56:47 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 257/769] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 15:56:47 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-942625841", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a45284f5-dd61-4b82-8470-01fa75cb3923"}], "security_groups": [{"name": "tempest-securitygroup--641199851"}], "key_name": "tempest-keypair-421873860", "user_data": "}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] validate_networks() for [('a45284f5-dd61-4b82-8470-01fa75cb3923', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting quotas for project 534f0fb654694b079fa89150594e1bbb. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting quotas for user b44feacbb8fa4680a965953c122cf31c and project 534f0fb654694b079fa89150594e1bbb. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:56:49 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:56:49 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.688483 Apr 14 15:56:49 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 257/770] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:56:49 2023] POST /compute/v2.1/servers => generated 399 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:56:49 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-36b425a6-5ba0-464a-8aa8-91209a4d6586 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:56:50 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-36b425a6-5ba0-464a-8aa8-91209a4d6586 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:56:50 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-36b425a6-5ba0-464a-8aa8-91209a4d6586 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:56:50 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-36b425a6-5ba0-464a-8aa8-91209a4d6586 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c" status: 200 len: 1230 microversion: 2.1 time: 0.074773 Apr 14 15:56:50 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 257/771] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:56:49 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c => generated 1230 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:56:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4adfa25-25dc-44d5-9b0e-414185c6bf7c", "tag": "62212714-898b-4797-8121-7ff0e3a55c98"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:56:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] Creating event network-changed:62212714-898b-4797-8121-7ff0e3a55c98 for instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c on user Apr 14 15:56:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031564 Apr 14 15:56:52 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 258/772] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:56:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:56:54 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-1d94a18f-405e-4e67-82f0-3628d2f00999 req-81ccc1f7-2884-47a4-b7b4-389e6466b54f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4adfa25-25dc-44d5-9b0e-414185c6bf7c", "name": "network-vif-plugged", "status": "completed", "tag": "62212714-898b-4797-8121-7ff0e3a55c98"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:56:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1d94a18f-405e-4e67-82f0-3628d2f00999 req-81ccc1f7-2884-47a4-b7b4-389e6466b54f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1d94a18f-405e-4e67-82f0-3628d2f00999 req-81ccc1f7-2884-47a4-b7b4-389e6466b54f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1d94a18f-405e-4e67-82f0-3628d2f00999 req-81ccc1f7-2884-47a4-b7b4-389e6466b54f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-1d94a18f-405e-4e67-82f0-3628d2f00999 req-81ccc1f7-2884-47a4-b7b4-389e6466b54f service nova] Creating event network-vif-plugged:62212714-898b-4797-8121-7ff0e3a55c98 for instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c on user Apr 14 15:56:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-1d94a18f-405e-4e67-82f0-3628d2f00999 req-81ccc1f7-2884-47a4-b7b4-389e6466b54f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047794 Apr 14 15:56:54 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 258/773] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:56:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:56:56 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-a4064fec-1e5b-487b-b7ce-241f74546dff req-9118fd57-d523-4dab-baff-777f049385eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4adfa25-25dc-44d5-9b0e-414185c6bf7c", "name": "network-vif-plugged", "status": "completed", "tag": "62212714-898b-4797-8121-7ff0e3a55c98"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:56:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a4064fec-1e5b-487b-b7ce-241f74546dff req-9118fd57-d523-4dab-baff-777f049385eb service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:56:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a4064fec-1e5b-487b-b7ce-241f74546dff req-9118fd57-d523-4dab-baff-777f049385eb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:56:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a4064fec-1e5b-487b-b7ce-241f74546dff req-9118fd57-d523-4dab-baff-777f049385eb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:56:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-a4064fec-1e5b-487b-b7ce-241f74546dff req-9118fd57-d523-4dab-baff-777f049385eb service nova] Creating event network-vif-plugged:62212714-898b-4797-8121-7ff0e3a55c98 for instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c on user Apr 14 15:56:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-a4064fec-1e5b-487b-b7ce-241f74546dff req-9118fd57-d523-4dab-baff-777f049385eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030813 Apr 14 15:56:56 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 258/774] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:56:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:57:03 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:03 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:03 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:03 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-256021d3-770f-4305-acfc-d12e1e346e93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:57:03 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-256021d3-770f-4305-acfc-d12e1e346e93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:57:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-256021d3-770f-4305-acfc-d12e1e346e93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-256021d3-770f-4305-acfc-d12e1e346e93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-256021d3-770f-4305-acfc-d12e1e346e93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-256021d3-770f-4305-acfc-d12e1e346e93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-256021d3-770f-4305-acfc-d12e1e346e93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-256021d3-770f-4305-acfc-d12e1e346e93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:03 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-256021d3-770f-4305-acfc-d12e1e346e93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] HTTP exception thrown: Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 could not be found. Apr 14 15:57:03 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-256021d3-770f-4305-acfc-d12e1e346e93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Request method failure captured: Apr 14 15:57:03 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 HTTP/1.1 Apr 14 15:57:03 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:57:03 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:57:03 user devstack@n-api.service[61876]: Connection: close Apr 14 15:57:03 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:57:03 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:57:03 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:57:03 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:57:03 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXMADDE-NwjnZp9tW6I-ow3ZVfqszgqfHI_8rUrEc0ahvwDf5YlB1FwQtPLwOODY0crV9knzZMCW1xm607j0R2F6BLfBnzFR0ca57rAqIXziDpwarj4S20EX-3O7Do0bFRZFs3IE_uyZfLVMB5sjuaHDz4eYfDz2AuF9lbEBPA5m7iY Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Project-Id: 584a53650c014f87b9622f2011996200 Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-756745587 Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/584a53650c014f87b9622f2011996200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/584a53650c014f87b9622f2011996200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/584a53650c014f87b9622f2011996200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-756745587 Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Tenant-Id: 584a53650c014f87b9622f2011996200 Apr 14 15:57:03 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-756745587 Apr 14 15:57:03 user devstack@n-api.service[61876]: X-User: tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member Apr 14 15:57:03 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:57:03 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:57:03 user devstack@n-api.service[61876]: X-User-Id: efb645d110464e7e85d7c955ee9f3466 Apr 14 15:57:03 user devstack@n-api.service[61876]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member Apr 14 15:57:03 user devstack@n-api.service[61876]: method: > Apr 14 15:57:03 user devstack@n-api.service[61876]: exception: Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 could not be found. Apr 14 15:57:03 user devstack@n-api.service[61876]: action_args: {'id': 'e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3'} Apr 14 15:57:03 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 could not be found. Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 could not be found. Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 could not be found. Apr 14 15:57:03 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:57:03 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-256021d3-770f-4305-acfc-d12e1e346e93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Returning 404 to user: Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:57:03 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-256021d3-770f-4305-acfc-d12e1e346e93 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" status: 404 len: 111 microversion: 2.87 time: 0.035394 Apr 14 15:57:03 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 259/775] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:57:03 2023] GET /compute/v2.1/servers/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:57:03 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:03 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:03 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:57:03 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:57:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:03 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:03 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:57:03 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c" status: 204 len: 0 microversion: 2.87 time: 0.108716 Apr 14 15:57:03 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 259/776] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 15:57:03 2023] DELETE /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 15:57:03 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:03 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-54c149b6-bed5-4c5d-8cfb-e83d86182826 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:57:03 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-54c149b6-bed5-4c5d-8cfb-e83d86182826 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:57:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-54c149b6-bed5-4c5d-8cfb-e83d86182826 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-54c149b6-bed5-4c5d-8cfb-e83d86182826 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-54c149b6-bed5-4c5d-8cfb-e83d86182826 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-54c149b6-bed5-4c5d-8cfb-e83d86182826 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-54c149b6-bed5-4c5d-8cfb-e83d86182826 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-54c149b6-bed5-4c5d-8cfb-e83d86182826 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:04 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-1581af2f-93ec-4178-93e6-442ef82644b2 req-02342905-fc08-4016-a790-4ceb7d765924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e21d6b-fc8f-4373-a54f-452ab5fa169c", "name": "network-vif-unplugged", "status": "completed", "tag": "e04c622c-58ef-477e-8d37-eb052355492e"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:57:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-1581af2f-93ec-4178-93e6-442ef82644b2 req-02342905-fc08-4016-a790-4ceb7d765924 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-1581af2f-93ec-4178-93e6-442ef82644b2 req-02342905-fc08-4016-a790-4ceb7d765924 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-1581af2f-93ec-4178-93e6-442ef82644b2 req-02342905-fc08-4016-a790-4ceb7d765924 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:04 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-1581af2f-93ec-4178-93e6-442ef82644b2 req-02342905-fc08-4016-a790-4ceb7d765924 service nova] Creating event network-vif-unplugged:e04c622c-58ef-477e-8d37-eb052355492e for instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c on user Apr 14 15:57:04 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-1581af2f-93ec-4178-93e6-442ef82644b2 req-02342905-fc08-4016-a790-4ceb7d765924 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038364 Apr 14 15:57:04 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 260/777] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:57:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:57:04 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-54c149b6-bed5-4c5d-8cfb-e83d86182826 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:57:04 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-54c149b6-bed5-4c5d-8cfb-e83d86182826 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:57:04 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-54c149b6-bed5-4c5d-8cfb-e83d86182826 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:57:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-54c149b6-bed5-4c5d-8cfb-e83d86182826 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c" status: 200 len: 1696 microversion: 2.87 time: 0.388783 Apr 14 15:57:04 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 259/778] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:57:03 2023] GET /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c => generated 1696 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:57:05 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-59716b48-0879-4aba-b3da-ddc05a283991 req-dd4d9570-81b0-46cf-851e-f96473fb5899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e21d6b-fc8f-4373-a54f-452ab5fa169c", "name": "network-vif-deleted", "tag": "e04c622c-58ef-477e-8d37-eb052355492e"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:57:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-59716b48-0879-4aba-b3da-ddc05a283991 req-dd4d9570-81b0-46cf-851e-f96473fb5899 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-59716b48-0879-4aba-b3da-ddc05a283991 req-dd4d9570-81b0-46cf-851e-f96473fb5899 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-59716b48-0879-4aba-b3da-ddc05a283991 req-dd4d9570-81b0-46cf-851e-f96473fb5899 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:05 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-59716b48-0879-4aba-b3da-ddc05a283991 req-dd4d9570-81b0-46cf-851e-f96473fb5899 service nova] Creating event network-vif-deleted:e04c622c-58ef-477e-8d37-eb052355492e for instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c on user Apr 14 15:57:05 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-59716b48-0879-4aba-b3da-ddc05a283991 req-dd4d9570-81b0-46cf-851e-f96473fb5899 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029101 Apr 14 15:57:05 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 260/779] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:57:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:57:06 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-9382fd30-a51b-4bec-865e-74ccd0f128dc req-66546d63-7855-4efa-8375-bfef0bc3a772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e21d6b-fc8f-4373-a54f-452ab5fa169c", "name": "network-vif-plugged", "status": "completed", "tag": "e04c622c-58ef-477e-8d37-eb052355492e"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:57:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9382fd30-a51b-4bec-865e-74ccd0f128dc req-66546d63-7855-4efa-8375-bfef0bc3a772 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9382fd30-a51b-4bec-865e-74ccd0f128dc req-66546d63-7855-4efa-8375-bfef0bc3a772 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9382fd30-a51b-4bec-865e-74ccd0f128dc req-66546d63-7855-4efa-8375-bfef0bc3a772 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:06 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-9382fd30-a51b-4bec-865e-74ccd0f128dc req-66546d63-7855-4efa-8375-bfef0bc3a772 service nova] Creating event network-vif-plugged:e04c622c-58ef-477e-8d37-eb052355492e for instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c on user Apr 14 15:57:06 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-9382fd30-a51b-4bec-865e-74ccd0f128dc req-66546d63-7855-4efa-8375-bfef0bc3a772 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028184 Apr 14 15:57:06 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 261/780] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:57:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:57:10 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-76c30dab-ed3e-4824-a205-ae23d13df84c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:57:10 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-76c30dab-ed3e-4824-a205-ae23d13df84c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:57:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-76c30dab-ed3e-4824-a205-ae23d13df84c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-76c30dab-ed3e-4824-a205-ae23d13df84c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-76c30dab-ed3e-4824-a205-ae23d13df84c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-76c30dab-ed3e-4824-a205-ae23d13df84c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-76c30dab-ed3e-4824-a205-ae23d13df84c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-76c30dab-ed3e-4824-a205-ae23d13df84c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:10 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-76c30dab-ed3e-4824-a205-ae23d13df84c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.408452 Apr 14 15:57:10 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 260/781] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 15:57:10 2023] GET /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110/os-interface => generated 283 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:57:11 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0fcb3f5-6676-43a8-b6e2-2da51d195110", "tag": "e3e86dec-e3bf-4584-8918-eb5d22e8428a"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:57:11 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:11 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:11 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:11 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] Creating event network-changed:e3e86dec-e3bf-4584-8918-eb5d22e8428a for instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 on user Apr 14 15:57:11 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032352 Apr 14 15:57:11 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 261/782] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:57:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-866404495", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "b5636fab-ff0a-4313-afb7-6f7fa779e363"}], "security_groups": [{"name": "tempest-securitygroup--448801128"}], "key_name": "tempest-keypair-2131359708", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "6e0de370-c626-4a9d-a636-fbb7cfdb81a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] validate_networks() for [('b5636fab-ff0a-4313-afb7-6f7fa779e363', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for project 95e26fa4727e46479d108fe49e225706. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for user 3062186c340a4cfe875d5455b0ace246 and project 95e26fa4727e46479d108fe49e225706. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:57:15 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e0de370-c626-4a9d-a636-fbb7cfdb81a8',volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:57:16 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.783984 Apr 14 15:57:16 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 262/783] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 15:57:15 2023] POST /compute/v2.1/servers => generated 403 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 15:57:16 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-1d64a276-d25c-4bc9-a512-9186e6757bd6 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:57:16 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-1d64a276-d25c-4bc9-a512-9186e6757bd6 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:57:16 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-1d64a276-d25c-4bc9-a512-9186e6757bd6 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:57:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-1d64a276-d25c-4bc9-a512-9186e6757bd6 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5" status: 200 len: 1075 microversion: 2.1 time: 0.066071 Apr 14 15:57:16 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 261/784] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:57:16 2023] GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 => generated 1075 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:57:17 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:57:17 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:57:17 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:17 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:17 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:57:17 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/885a9f3e-7deb-47e9-84df-8879ee0659a1" status: 204 len: 0 microversion: 2.1 time: 0.124720 Apr 14 15:57:17 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 262/785] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:57:17 2023] DELETE /compute/v2.1/servers/885a9f3e-7deb-47e9-84df-8879ee0659a1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:57:17 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-960105b7-5309-436b-9d9a-e24d61ef3173 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:57:17 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-960105b7-5309-436b-9d9a-e24d61ef3173 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:57:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-960105b7-5309-436b-9d9a-e24d61ef3173 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-960105b7-5309-436b-9d9a-e24d61ef3173 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-960105b7-5309-436b-9d9a-e24d61ef3173 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-960105b7-5309-436b-9d9a-e24d61ef3173 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-960105b7-5309-436b-9d9a-e24d61ef3173 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-960105b7-5309-436b-9d9a-e24d61ef3173 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:18 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-960105b7-5309-436b-9d9a-e24d61ef3173 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324bd0e5d45b424fbf12bcf336f10894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b71f0ba039b408691746831d3ca9d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:57:18 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-960105b7-5309-436b-9d9a-e24d61ef3173 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/885a9f3e-7deb-47e9-84df-8879ee0659a1" status: 200 len: 1461 microversion: 2.1 time: 0.432559 Apr 14 15:57:18 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 263/786] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:57:17 2023] GET /compute/v2.1/servers/885a9f3e-7deb-47e9-84df-8879ee0659a1 => generated 1461 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:57:18 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-0cd2de77-5334-41d2-8922-3119bc5cf6e2 req-3a0510e5-8e15-4a64-8810-a9c88fa90c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "885a9f3e-7deb-47e9-84df-8879ee0659a1", "name": "network-vif-unplugged", "status": "completed", "tag": "1f437122-97ba-41e8-9d63-5d1686920360"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:57:18 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0cd2de77-5334-41d2-8922-3119bc5cf6e2 req-3a0510e5-8e15-4a64-8810-a9c88fa90c8b service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0cd2de77-5334-41d2-8922-3119bc5cf6e2 req-3a0510e5-8e15-4a64-8810-a9c88fa90c8b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0cd2de77-5334-41d2-8922-3119bc5cf6e2 req-3a0510e5-8e15-4a64-8810-a9c88fa90c8b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:18 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-0cd2de77-5334-41d2-8922-3119bc5cf6e2 req-3a0510e5-8e15-4a64-8810-a9c88fa90c8b service nova] Creating event network-vif-unplugged:1f437122-97ba-41e8-9d63-5d1686920360 for instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 on user Apr 14 15:57:18 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-0cd2de77-5334-41d2-8922-3119bc5cf6e2 req-3a0510e5-8e15-4a64-8810-a9c88fa90c8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030770 Apr 14 15:57:18 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 262/787] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:57:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:57:19 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-bd8c02a4-62d7-4054-91bd-dc40893235c8 req-3cc83b66-d8bd-49d6-a6c5-d1ab4c6e9cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "885a9f3e-7deb-47e9-84df-8879ee0659a1", "name": "network-vif-deleted", "tag": "1f437122-97ba-41e8-9d63-5d1686920360"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:57:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-bd8c02a4-62d7-4054-91bd-dc40893235c8 req-3cc83b66-d8bd-49d6-a6c5-d1ab4c6e9cde service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-bd8c02a4-62d7-4054-91bd-dc40893235c8 req-3cc83b66-d8bd-49d6-a6c5-d1ab4c6e9cde service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-bd8c02a4-62d7-4054-91bd-dc40893235c8 req-3cc83b66-d8bd-49d6-a6c5-d1ab4c6e9cde service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:19 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-bd8c02a4-62d7-4054-91bd-dc40893235c8 req-3cc83b66-d8bd-49d6-a6c5-d1ab4c6e9cde service nova] Creating event network-vif-deleted:1f437122-97ba-41e8-9d63-5d1686920360 for instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 on user Apr 14 15:57:19 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-bd8c02a4-62d7-4054-91bd-dc40893235c8 req-3cc83b66-d8bd-49d6-a6c5-d1ab4c6e9cde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038345 Apr 14 15:57:19 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 263/788] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:57:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 15:57:20 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-da7cafe2-f572-416d-8eea-830cb5f011d4 req-4b983253-b352-4ea5-a3f8-d15e81e8c02a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "885a9f3e-7deb-47e9-84df-8879ee0659a1", "name": "network-vif-plugged", "status": "completed", "tag": "1f437122-97ba-41e8-9d63-5d1686920360"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:57:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-da7cafe2-f572-416d-8eea-830cb5f011d4 req-4b983253-b352-4ea5-a3f8-d15e81e8c02a service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-da7cafe2-f572-416d-8eea-830cb5f011d4 req-4b983253-b352-4ea5-a3f8-d15e81e8c02a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-da7cafe2-f572-416d-8eea-830cb5f011d4 req-4b983253-b352-4ea5-a3f8-d15e81e8c02a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:20 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-da7cafe2-f572-416d-8eea-830cb5f011d4 req-4b983253-b352-4ea5-a3f8-d15e81e8c02a service nova] Creating event network-vif-plugged:1f437122-97ba-41e8-9d63-5d1686920360 for instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 on user Apr 14 15:57:20 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-da7cafe2-f572-416d-8eea-830cb5f011d4 req-4b983253-b352-4ea5-a3f8-d15e81e8c02a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037229 Apr 14 15:57:20 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 264/789] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:57:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:57:21 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61119681-6ec1-4dee-bf91-908f479488d5", "tag": "bdc45130-027f-49b1-b33a-2a4adbc70f63"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:57:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:21 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:21 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] Creating event network-changed:bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance 61119681-6ec1-4dee-bf91-908f479488d5 on user Apr 14 15:57:21 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030227 Apr 14 15:57:21 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 263/790] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:57:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:57:24 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-42d65172-1450-41e1-89d3-8fb4a4b9591e req-c6386d46-d196-48f5-b07f-e54ffa714f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61119681-6ec1-4dee-bf91-908f479488d5", "name": "network-vif-plugged", "status": "completed", "tag": "bdc45130-027f-49b1-b33a-2a4adbc70f63"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:57:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-42d65172-1450-41e1-89d3-8fb4a4b9591e req-c6386d46-d196-48f5-b07f-e54ffa714f15 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-42d65172-1450-41e1-89d3-8fb4a4b9591e req-c6386d46-d196-48f5-b07f-e54ffa714f15 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:24 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-42d65172-1450-41e1-89d3-8fb4a4b9591e req-c6386d46-d196-48f5-b07f-e54ffa714f15 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:24 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-42d65172-1450-41e1-89d3-8fb4a4b9591e req-c6386d46-d196-48f5-b07f-e54ffa714f15 service nova] Creating event network-vif-plugged:bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance 61119681-6ec1-4dee-bf91-908f479488d5 on user Apr 14 15:57:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-42d65172-1450-41e1-89d3-8fb4a4b9591e req-c6386d46-d196-48f5-b07f-e54ffa714f15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095194 Apr 14 15:57:25 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 264/791] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:57:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:57:27 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:27 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:27 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-33498a5d-1a6e-49df-9c7c-087748dba2ea req-e8cc8b78-759c-4832-807f-6cd66c66a261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61119681-6ec1-4dee-bf91-908f479488d5", "name": "network-vif-plugged", "status": "completed", "tag": "bdc45130-027f-49b1-b33a-2a4adbc70f63"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:57:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-33498a5d-1a6e-49df-9c7c-087748dba2ea req-e8cc8b78-759c-4832-807f-6cd66c66a261 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-33498a5d-1a6e-49df-9c7c-087748dba2ea req-e8cc8b78-759c-4832-807f-6cd66c66a261 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-33498a5d-1a6e-49df-9c7c-087748dba2ea req-e8cc8b78-759c-4832-807f-6cd66c66a261 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:27 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-33498a5d-1a6e-49df-9c7c-087748dba2ea req-e8cc8b78-759c-4832-807f-6cd66c66a261 service nova] Creating event network-vif-plugged:bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance 61119681-6ec1-4dee-bf91-908f479488d5 on user Apr 14 15:57:27 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-33498a5d-1a6e-49df-9c7c-087748dba2ea req-e8cc8b78-759c-4832-807f-6cd66c66a261 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101851 Apr 14 15:57:27 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 265/792] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:57:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:57:40 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:40 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:40 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=16 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:40 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-904cc392-9d3b-45ab-8c00-abb68b1d9e41 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:57:40 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-904cc392-9d3b-45ab-8c00-abb68b1d9e41 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:57:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-904cc392-9d3b-45ab-8c00-abb68b1d9e41 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-904cc392-9d3b-45ab-8c00-abb68b1d9e41 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-904cc392-9d3b-45ab-8c00-abb68b1d9e41 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-904cc392-9d3b-45ab-8c00-abb68b1d9e41 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-904cc392-9d3b-45ab-8c00-abb68b1d9e41 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-904cc392-9d3b-45ab-8c00-abb68b1d9e41 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:40 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-904cc392-9d3b-45ab-8c00-abb68b1d9e41 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:57:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-904cc392-9d3b-45ab-8c00-abb68b1d9e41 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c" status: 200 len: 1534 microversion: 2.1 time: 0.328340 Apr 14 15:57:40 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 264/793] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:57:40 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c => generated 1534 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:57:54 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:54 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:57:54 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-510c51dc-4b1e-42d7-91fc-f06fe36ddbfa tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:57:54 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-510c51dc-4b1e-42d7-91fc-f06fe36ddbfa tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:57:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-510c51dc-4b1e-42d7-91fc-f06fe36ddbfa tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-510c51dc-4b1e-42d7-91fc-f06fe36ddbfa tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-510c51dc-4b1e-42d7-91fc-f06fe36ddbfa tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-510c51dc-4b1e-42d7-91fc-f06fe36ddbfa tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:57:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-510c51dc-4b1e-42d7-91fc-f06fe36ddbfa tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:57:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-510c51dc-4b1e-42d7-91fc-f06fe36ddbfa tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:57:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-510c51dc-4b1e-42d7-91fc-f06fe36ddbfa tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] HTTP exception thrown: Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c could not be found. Apr 14 15:57:54 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-510c51dc-4b1e-42d7-91fc-f06fe36ddbfa tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Request method failure captured: Apr 14 15:57:54 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c HTTP/1.1 Apr 14 15:57:54 user devstack@n-api.service[61874]: Accept: application/json Apr 14 15:57:54 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 15:57:54 user devstack@n-api.service[61874]: Connection: close Apr 14 15:57:54 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 15:57:54 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 15:57:54 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 15:57:54 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 15:57:54 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXMADDE-NwjnZp9tW6I-ow3ZVfqszgqfHI_8rUrEc0ahvwDf5YlB1FwQtPLwOODY0crV9knzZMCW1xm607j0R2F6BLfBnzFR0ca57rAqIXziDpwarj4S20EX-3O7Do0bFRZFs3IE_uyZfLVMB5sjuaHDz4eYfDz2AuF9lbEBPA5m7iY Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Project-Id: 584a53650c014f87b9622f2011996200 Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-756745587 Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/584a53650c014f87b9622f2011996200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/584a53650c014f87b9622f2011996200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/584a53650c014f87b9622f2011996200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-756745587 Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Tenant-Id: 584a53650c014f87b9622f2011996200 Apr 14 15:57:54 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-756745587 Apr 14 15:57:54 user devstack@n-api.service[61874]: X-User: tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member Apr 14 15:57:54 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 15:57:54 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 15:57:54 user devstack@n-api.service[61874]: X-User-Id: efb645d110464e7e85d7c955ee9f3466 Apr 14 15:57:54 user devstack@n-api.service[61874]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member Apr 14 15:57:54 user devstack@n-api.service[61874]: method: > Apr 14 15:57:54 user devstack@n-api.service[61874]: exception: Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c could not be found. Apr 14 15:57:54 user devstack@n-api.service[61874]: action_args: {'id': 'd8e21d6b-fc8f-4373-a54f-452ab5fa169c'} Apr 14 15:57:54 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c could not be found. Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c could not be found. Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c could not be found. Apr 14 15:57:54 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 15:57:54 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-510c51dc-4b1e-42d7-91fc-f06fe36ddbfa tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Returning 404 to user: Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:57:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-510c51dc-4b1e-42d7-91fc-f06fe36ddbfa tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c" status: 404 len: 111 microversion: 2.87 time: 0.041839 Apr 14 15:57:54 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 265/794] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:57:54 2023] GET /compute/v2.1/servers/d8e21d6b-fc8f-4373-a54f-452ab5fa169c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:58:05 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:05 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=18 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:05 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-194e986a-eea0-4521-9785-563f9f103c96 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Action: 'create', calling method: .version_select at 0x7f29708641f0>, body: {"keypair": {"name": "tempest-keypair-506635828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBozYjZa3+L7ZaapG78zt//JX1aKtL9gK6w652fgXQCyNWMbZeFs3dLlpUJFQtL9sOYgL2wsRJ8VKTRuUg35WOo6Bi2bKvhvhXZzKawwCATnuTHiTMAKe03Rf2j5CZzitQ=="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:58:05 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-194e986a-eea0-4521-9785-563f9f103c96 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Getting quotas for project b0dd8e5513a94cc8b22c291bac3b066f. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:58:05 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-194e986a-eea0-4521-9785-563f9f103c96 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Getting quotas for user 194adad706f94ef89a86fbcb9d8888ac and project b0dd8e5513a94cc8b22c291bac3b066f. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:58:05 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-194e986a-eea0-4521-9785-563f9f103c96 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.205934 Apr 14 15:58:05 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 266/795] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 15:58:05 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 208 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 15:58:06 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-9d9f8496-2cc7-44a5-9b04-85738694ef2a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:58:06 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-9d9f8496-2cc7-44a5-9b04-85738694ef2a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:58:06 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:06 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9d9f8496-2cc7-44a5-9b04-85738694ef2a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9d9f8496-2cc7-44a5-9b04-85738694ef2a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9d9f8496-2cc7-44a5-9b04-85738694ef2a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9d9f8496-2cc7-44a5-9b04-85738694ef2a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9d9f8496-2cc7-44a5-9b04-85738694ef2a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9d9f8496-2cc7-44a5-9b04-85738694ef2a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:06 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-9d9f8496-2cc7-44a5-9b04-85738694ef2a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:58:06 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-9d9f8496-2cc7-44a5-9b04-85738694ef2a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5" status: 200 len: 1426 microversion: 2.1 time: 0.427557 Apr 14 15:58:06 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 265/796] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:58:06 2023] GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 => generated 1426 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:58:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1710480109", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "02907ca9-ef91-415d-916b-dcf4c9134b49"}], "security_groups": [{"name": "tempest-securitygroup--1049693988"}], "key_name": "tempest-keypair-506635828", "user_data": "}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:58:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:07 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] validate_networks() for [('02907ca9-ef91-415d-916b-dcf4c9134b49', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 15:58:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-79535922-e1dc-46f6-9b72-501397376711 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:58:08 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-79535922-e1dc-46f6-9b72-501397376711 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:58:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-79535922-e1dc-46f6-9b72-501397376711 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-79535922-e1dc-46f6-9b72-501397376711 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-79535922-e1dc-46f6-9b72-501397376711 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-79535922-e1dc-46f6-9b72-501397376711 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-79535922-e1dc-46f6-9b72-501397376711 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-79535922-e1dc-46f6-9b72-501397376711 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-79535922-e1dc-46f6-9b72-501397376711 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] HTTP exception thrown: Instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 could not be found. Apr 14 15:58:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-79535922-e1dc-46f6-9b72-501397376711 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Request method failure captured: Apr 14 15:58:08 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/885a9f3e-7deb-47e9-84df-8879ee0659a1 HTTP/1.1 Apr 14 15:58:08 user devstack@n-api.service[61876]: Accept: application/json Apr 14 15:58:08 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 15:58:08 user devstack@n-api.service[61876]: Connection: close Apr 14 15:58:08 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 15:58:08 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 15:58:08 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 15:58:08 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 15:58:08 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXdrn0WtFXYPcPkFsNaANRq1yfvX76B7smOO5a5w2zNq5APHkS2HVJhP2X-WWgWThVHGCPnZdMZowcqxeEX9wUcNu-XkQSFDXL_DeHfkoVk3lPdtd6cVkrtTaULZFRUocwxQB8PFKtjoikqHVNpjg_uRFTrA00QSLUpVGMBKXue_RjY Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Project-Id: 9b71f0ba039b408691746831d3ca9d91 Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Project-Name: tempest-VolumesNegativeTest-273784340 Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9b71f0ba039b408691746831d3ca9d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9b71f0ba039b408691746831d3ca9d91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9b71f0ba039b408691746831d3ca9d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Tenant: tempest-VolumesNegativeTest-273784340 Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Tenant-Id: 9b71f0ba039b408691746831d3ca9d91 Apr 14 15:58:08 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-VolumesNegativeTest-273784340 Apr 14 15:58:08 user devstack@n-api.service[61876]: X-User: tempest-VolumesNegativeTest-273784340-project-member Apr 14 15:58:08 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 15:58:08 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 15:58:08 user devstack@n-api.service[61876]: X-User-Id: 324bd0e5d45b424fbf12bcf336f10894 Apr 14 15:58:08 user devstack@n-api.service[61876]: X-User-Name: tempest-VolumesNegativeTest-273784340-project-member Apr 14 15:58:08 user devstack@n-api.service[61876]: method: > Apr 14 15:58:08 user devstack@n-api.service[61876]: exception: Instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 could not be found. Apr 14 15:58:08 user devstack@n-api.service[61876]: action_args: {'id': '885a9f3e-7deb-47e9-84df-8879ee0659a1'} Apr 14 15:58:08 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 could not be found. Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 could not be found. Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 could not be found. Apr 14 15:58:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 15:58:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-79535922-e1dc-46f6-9b72-501397376711 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Returning 404 to user: Instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:58:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-79535922-e1dc-46f6-9b72-501397376711 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/885a9f3e-7deb-47e9-84df-8879ee0659a1" status: 404 len: 111 microversion: 2.1 time: 0.035654 Apr 14 15:58:08 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 267/797] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:58:08 2023] GET /compute/v2.1/servers/885a9f3e-7deb-47e9-84df-8879ee0659a1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Getting quotas for project b0dd8e5513a94cc8b22c291bac3b066f. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Getting quotas for user 194adad706f94ef89a86fbcb9d8888ac and project b0dd8e5513a94cc8b22c291bac3b066f. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 15:58:08 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 15:58:08 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.726738 Apr 14 15:58:08 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 266/798] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 15:58:07 2023] POST /compute/v2.1/servers => generated 400 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 15:58:08 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a5281951-8f52-4cd8-9574-bda85c413711 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:58:08 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a5281951-8f52-4cd8-9574-bda85c413711 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:58:08 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-a5281951-8f52-4cd8-9574-bda85c413711 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:58:08 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-a5281951-8f52-4cd8-9574-bda85c413711 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:58:08 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-a5281951-8f52-4cd8-9574-bda85c413711 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:58:08 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a5281951-8f52-4cd8-9574-bda85c413711 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6" status: 200 len: 1275 microversion: 2.20 time: 0.085297 Apr 14 15:58:08 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 266/799] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:58:08 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:58:10 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ebde9c7-b620-4553-856c-c6a3429381b6", "tag": "e7e2966b-fc86-47d5-a656-93ba5e362a42"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:58:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] Creating event network-changed:e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 on user Apr 14 15:58:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088117 Apr 14 15:58:10 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 268/800] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:58:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:58:12 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-da18cb98-2cb2-4705-bc17-368a2c9c2db1 req-5f796f98-814c-45c7-869c-7c71334fc474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebde9c7-b620-4553-856c-c6a3429381b6", "name": "network-vif-plugged", "status": "completed", "tag": "e7e2966b-fc86-47d5-a656-93ba5e362a42"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:58:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-da18cb98-2cb2-4705-bc17-368a2c9c2db1 req-5f796f98-814c-45c7-869c-7c71334fc474 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-da18cb98-2cb2-4705-bc17-368a2c9c2db1 req-5f796f98-814c-45c7-869c-7c71334fc474 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-da18cb98-2cb2-4705-bc17-368a2c9c2db1 req-5f796f98-814c-45c7-869c-7c71334fc474 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:12 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-da18cb98-2cb2-4705-bc17-368a2c9c2db1 req-5f796f98-814c-45c7-869c-7c71334fc474 service nova] Creating event network-vif-plugged:e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 on user Apr 14 15:58:12 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-da18cb98-2cb2-4705-bc17-368a2c9c2db1 req-5f796f98-814c-45c7-869c-7c71334fc474 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048402 Apr 14 15:58:12 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 267/801] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:58:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:58:14 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-496d4054-165b-4925-a420-967bfb80fbc3 req-f752f6b2-fd25-4557-b3c8-ec57e5d33664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebde9c7-b620-4553-856c-c6a3429381b6", "name": "network-vif-plugged", "status": "completed", "tag": "e7e2966b-fc86-47d5-a656-93ba5e362a42"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:58:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-496d4054-165b-4925-a420-967bfb80fbc3 req-f752f6b2-fd25-4557-b3c8-ec57e5d33664 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-496d4054-165b-4925-a420-967bfb80fbc3 req-f752f6b2-fd25-4557-b3c8-ec57e5d33664 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-496d4054-165b-4925-a420-967bfb80fbc3 req-f752f6b2-fd25-4557-b3c8-ec57e5d33664 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:14 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-496d4054-165b-4925-a420-967bfb80fbc3 req-f752f6b2-fd25-4557-b3c8-ec57e5d33664 service nova] Creating event network-vif-plugged:e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 on user Apr 14 15:58:14 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-496d4054-165b-4925-a420-967bfb80fbc3 req-f752f6b2-fd25-4557-b3c8-ec57e5d33664 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030601 Apr 14 15:58:14 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 267/802] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:58:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:58:40 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:40 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:40 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:40 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-8f927a63-4505-4805-81ea-d20624477d34 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:58:40 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-8f927a63-4505-4805-81ea-d20624477d34 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:58:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8f927a63-4505-4805-81ea-d20624477d34 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8f927a63-4505-4805-81ea-d20624477d34 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8f927a63-4505-4805-81ea-d20624477d34 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8f927a63-4505-4805-81ea-d20624477d34 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8f927a63-4505-4805-81ea-d20624477d34 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:40 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8f927a63-4505-4805-81ea-d20624477d34 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:40 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-8f927a63-4505-4805-81ea-d20624477d34 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.205654 Apr 14 15:58:40 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 269/803] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 15:58:40 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-interface => generated 282 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:58:41 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:41 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:41 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:41 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:41 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4adfa25-25dc-44d5-9b0e-414185c6bf7c", "tag": "62212714-898b-4797-8121-7ff0e3a55c98"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:58:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] Creating event network-changed:62212714-898b-4797-8121-7ff0e3a55c98 for instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c on user Apr 14 15:58:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040275 Apr 14 15:58:41 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 268/804] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:58:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:58:41 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:41 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=8 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:41 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=8 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:41 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-ecaf095f-a22a-41ad-9ea0-66b82d17e47f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:58:41 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-ecaf095f-a22a-41ad-9ea0-66b82d17e47f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:58:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ecaf095f-a22a-41ad-9ea0-66b82d17e47f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ecaf095f-a22a-41ad-9ea0-66b82d17e47f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ecaf095f-a22a-41ad-9ea0-66b82d17e47f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ecaf095f-a22a-41ad-9ea0-66b82d17e47f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ecaf095f-a22a-41ad-9ea0-66b82d17e47f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ecaf095f-a22a-41ad-9ea0-66b82d17e47f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:41 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-ecaf095f-a22a-41ad-9ea0-66b82d17e47f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/ips" status: 200 len: 103 microversion: 2.1 time: 0.041473 Apr 14 15:58:41 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 268/805] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 15:58:41 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/ips => generated 103 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:58:44 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:58:44 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:58:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:44 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321889 Apr 14 15:58:44 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 270/806] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:58:44 2023] POST /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:58:51 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:51 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:51 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4360e76c-30f5-495b-91a5-aaa5f9228ea7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:58:51 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-4360e76c-30f5-495b-91a5-aaa5f9228ea7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:58:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4360e76c-30f5-495b-91a5-aaa5f9228ea7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4360e76c-30f5-495b-91a5-aaa5f9228ea7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4360e76c-30f5-495b-91a5-aaa5f9228ea7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4360e76c-30f5-495b-91a5-aaa5f9228ea7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4360e76c-30f5-495b-91a5-aaa5f9228ea7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:51 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4360e76c-30f5-495b-91a5-aaa5f9228ea7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:51 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-4360e76c-30f5-495b-91a5-aaa5f9228ea7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048053 Apr 14 15:58:51 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 269/807] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:58:51 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:58:51 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-cacfba1b-c5d1-42d7-8336-0b8ccf0d824c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:58:51 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-cacfba1b-c5d1-42d7-8336-0b8ccf0d824c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:58:51 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:51 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cacfba1b-c5d1-42d7-8336-0b8ccf0d824c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cacfba1b-c5d1-42d7-8336-0b8ccf0d824c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cacfba1b-c5d1-42d7-8336-0b8ccf0d824c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cacfba1b-c5d1-42d7-8336-0b8ccf0d824c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cacfba1b-c5d1-42d7-8336-0b8ccf0d824c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cacfba1b-c5d1-42d7-8336-0b8ccf0d824c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-cacfba1b-c5d1-42d7-8336-0b8ccf0d824c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments/2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13" status: 200 len: 194 microversion: 2.1 time: 0.046211 Apr 14 15:58:52 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 269/808] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 15:58:51 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments/2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:58:54 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:54 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:58:54 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:58:54 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:58:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:54 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306700 Apr 14 15:58:54 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 271/809] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 15:58:54 2023] POST /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:58:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-84c31a31-0ce8-4a29-97b7-b6de9ed2755d tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:58:58 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-84c31a31-0ce8-4a29-97b7-b6de9ed2755d tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:58:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-84c31a31-0ce8-4a29-97b7-b6de9ed2755d tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-84c31a31-0ce8-4a29-97b7-b6de9ed2755d tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-84c31a31-0ce8-4a29-97b7-b6de9ed2755d tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-84c31a31-0ce8-4a29-97b7-b6de9ed2755d tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:58:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-84c31a31-0ce8-4a29-97b7-b6de9ed2755d tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:58:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-84c31a31-0ce8-4a29-97b7-b6de9ed2755d tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:58:58 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-84c31a31-0ce8-4a29-97b7-b6de9ed2755d tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:58:58 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-84c31a31-0ce8-4a29-97b7-b6de9ed2755d tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:58:58 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-84c31a31-0ce8-4a29-97b7-b6de9ed2755d tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:58:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-84c31a31-0ce8-4a29-97b7-b6de9ed2755d tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6" status: 200 len: 1587 microversion: 2.20 time: 0.290041 Apr 14 15:58:58 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 270/810] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:58:58 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 => generated 1587 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:59:02 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-8fe1c162-c405-48ac-825a-8084f6d555ab tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:02 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-8fe1c162-c405-48ac-825a-8084f6d555ab tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:02 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:59:02 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:59:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8fe1c162-c405-48ac-825a-8084f6d555ab tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8fe1c162-c405-48ac-825a-8084f6d555ab tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8fe1c162-c405-48ac-825a-8084f6d555ab tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8fe1c162-c405-48ac-825a-8084f6d555ab tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8fe1c162-c405-48ac-825a-8084f6d555ab tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-8fe1c162-c405-48ac-825a-8084f6d555ab tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-8fe1c162-c405-48ac-825a-8084f6d555ab tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047080 Apr 14 15:59:02 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 270/811] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:59:02 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:59:02 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-02f0f8de-088b-44d2-af2d-f9042c1a7845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:02 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-02f0f8de-088b-44d2-af2d-f9042c1a7845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-02f0f8de-088b-44d2-af2d-f9042c1a7845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-02f0f8de-088b-44d2-af2d-f9042c1a7845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-02f0f8de-088b-44d2-af2d-f9042c1a7845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-02f0f8de-088b-44d2-af2d-f9042c1a7845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-02f0f8de-088b-44d2-af2d-f9042c1a7845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:02 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-02f0f8de-088b-44d2-af2d-f9042c1a7845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:02 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-02f0f8de-088b-44d2-af2d-f9042c1a7845 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments/2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13" status: 200 len: 194 microversion: 2.1 time: 0.040793 Apr 14 15:59:02 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 272/812] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 15:59:02 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments/2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:59:02 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:02 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:02 user devstack@n-api.service[61874]: DEBUG nova.objects.instance [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'services' on Instance uuid e4adfa25-25dc-44d5-9b0e-414185c6bf7c {{(pid=61874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:59:02 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments/2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13" status: 202 len: 0 microversion: 2.1 time: 0.157845 Apr 14 15:59:02 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 271/813] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:59:02 2023] DELETE /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments/2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:59:04 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-d0b46e32-1091-4d9d-b72d-6b56e12c0adf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:04 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d0b46e32-1091-4d9d-b72d-6b56e12c0adf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d0b46e32-1091-4d9d-b72d-6b56e12c0adf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d0b46e32-1091-4d9d-b72d-6b56e12c0adf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d0b46e32-1091-4d9d-b72d-6b56e12c0adf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d0b46e32-1091-4d9d-b72d-6b56e12c0adf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d0b46e32-1091-4d9d-b72d-6b56e12c0adf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d0b46e32-1091-4d9d-b72d-6b56e12c0adf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-d0b46e32-1091-4d9d-b72d-6b56e12c0adf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments/60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7" status: 200 len: 194 microversion: 2.1 time: 0.047706 Apr 14 15:59:04 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 271/814] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 15:59:04 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments/60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:59:04 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:04 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:05 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'services' on Instance uuid e4adfa25-25dc-44d5-9b0e-414185c6bf7c {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 15:59:05 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments/60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7" status: 202 len: 0 microversion: 2.1 time: 0.169062 Apr 14 15:59:05 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 273/815] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 15:59:04 2023] DELETE /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments/60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:59:06 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-071f4cdf-a655-4722-a93e-ad78774e0bea tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:06 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-071f4cdf-a655-4722-a93e-ad78774e0bea tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-071f4cdf-a655-4722-a93e-ad78774e0bea tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-071f4cdf-a655-4722-a93e-ad78774e0bea tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-071f4cdf-a655-4722-a93e-ad78774e0bea tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-071f4cdf-a655-4722-a93e-ad78774e0bea tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-071f4cdf-a655-4722-a93e-ad78774e0bea tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-071f4cdf-a655-4722-a93e-ad78774e0bea tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:06 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-071f4cdf-a655-4722-a93e-ad78774e0bea tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.156108 Apr 14 15:59:06 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 272/816] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 15:59:06 2023] GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5/os-interface => generated 282 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-1303eec1-dbbd-4292-a5e5-c09aa8a68cd2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-1303eec1-dbbd-4292-a5e5-c09aa8a68cd2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1303eec1-dbbd-4292-a5e5-c09aa8a68cd2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1303eec1-dbbd-4292-a5e5-c09aa8a68cd2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1303eec1-dbbd-4292-a5e5-c09aa8a68cd2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1303eec1-dbbd-4292-a5e5-c09aa8a68cd2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1303eec1-dbbd-4292-a5e5-c09aa8a68cd2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1303eec1-dbbd-4292-a5e5-c09aa8a68cd2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:07 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-1303eec1-dbbd-4292-a5e5-c09aa8a68cd2 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048426 Apr 14 15:59:07 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 272/817] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:59:07 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:59:07 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-b2dbe042-bda0-4072-8fc2-ef0b444c9059 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:07 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-b2dbe042-bda0-4072-8fc2-ef0b444c9059 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b2dbe042-bda0-4072-8fc2-ef0b444c9059 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b2dbe042-bda0-4072-8fc2-ef0b444c9059 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b2dbe042-bda0-4072-8fc2-ef0b444c9059 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b2dbe042-bda0-4072-8fc2-ef0b444c9059 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b2dbe042-bda0-4072-8fc2-ef0b444c9059 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-b2dbe042-bda0-4072-8fc2-ef0b444c9059 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:07 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-b2dbe042-bda0-4072-8fc2-ef0b444c9059 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048743 Apr 14 15:59:07 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 274/818] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 15:59:07 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:59:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c" status: 204 len: 0 microversion: 2.1 time: 0.117284 Apr 14 15:59:07 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 273/819] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:59:07 2023] DELETE /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a009dd76-3c13-4207-8c3e-bda28a3ba12e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a009dd76-3c13-4207-8c3e-bda28a3ba12e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:07 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0fcb3f5-6676-43a8-b6e2-2da51d195110", "tag": "e3e86dec-e3bf-4584-8918-eb5d22e8428a"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a009dd76-3c13-4207-8c3e-bda28a3ba12e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a009dd76-3c13-4207-8c3e-bda28a3ba12e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a009dd76-3c13-4207-8c3e-bda28a3ba12e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a009dd76-3c13-4207-8c3e-bda28a3ba12e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a009dd76-3c13-4207-8c3e-bda28a3ba12e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a009dd76-3c13-4207-8c3e-bda28a3ba12e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:07 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] Creating event network-changed:e3e86dec-e3bf-4584-8918-eb5d22e8428a for instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 on user Apr 14 15:59:07 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031934 Apr 14 15:59:07 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 275/820] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:59:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2c149c1e-3c00-4127-954f-b6e97a92b6dc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-2c149c1e-3c00-4127-954f-b6e97a92b6dc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2c149c1e-3c00-4127-954f-b6e97a92b6dc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2c149c1e-3c00-4127-954f-b6e97a92b6dc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2c149c1e-3c00-4127-954f-b6e97a92b6dc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2c149c1e-3c00-4127-954f-b6e97a92b6dc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2c149c1e-3c00-4127-954f-b6e97a92b6dc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2c149c1e-3c00-4127-954f-b6e97a92b6dc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:07 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-2c149c1e-3c00-4127-954f-b6e97a92b6dc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:59:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-2c149c1e-3c00-4127-954f-b6e97a92b6dc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5" status: 200 len: 1426 microversion: 2.1 time: 0.170779 Apr 14 15:59:07 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 274/821] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:59:07 2023] GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 => generated 1426 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:08 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-a009dd76-3c13-4207-8c3e-bda28a3ba12e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:59:08 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a009dd76-3c13-4207-8c3e-bda28a3ba12e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c" status: 200 len: 1659 microversion: 2.1 time: 0.251992 Apr 14 15:59:08 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 273/822] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:59:07 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c => generated 1659 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Old instance type m1.nano, new instance type m1.micro {{(pid=61876) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for project 95e26fa4727e46479d108fe49e225706. Resources: {'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting quotas for user 3062186c340a4cfe875d5455b0ace246 and project 95e26fa4727e46479d108fe49e225706. Resources: {'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 15:59:08 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 15:59:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "POST /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5/action" status: 202 len: 0 microversion: 2.1 time: 0.307402 Apr 14 15:59:08 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 276/823] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 15:59:08 2023] POST /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:59:08 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-78c4700c-141d-4265-98a3-39d699c607b4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:08 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-78c4700c-141d-4265-98a3-39d699c607b4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-78c4700c-141d-4265-98a3-39d699c607b4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-78c4700c-141d-4265-98a3-39d699c607b4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-78c4700c-141d-4265-98a3-39d699c607b4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-78c4700c-141d-4265-98a3-39d699c607b4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-78c4700c-141d-4265-98a3-39d699c607b4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-78c4700c-141d-4265-98a3-39d699c607b4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:08 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-78c4700c-141d-4265-98a3-39d699c607b4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:59:08 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-78c4700c-141d-4265-98a3-39d699c607b4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5" status: 200 len: 1435 microversion: 2.1 time: 0.172062 Apr 14 15:59:08 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 275/824] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:59:08 2023] GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 => generated 1435 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:59:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61119681-6ec1-4dee-bf91-908f479488d5", "tag": "bdc45130-027f-49b1-b33a-2a4adbc70f63"}, {"server_uuid": "e4adfa25-25dc-44d5-9b0e-414185c6bf7c", "name": "network-vif-unplugged", "status": "completed", "tag": "62212714-898b-4797-8121-7ff0e3a55c98"}, {"server_uuid": "e4adfa25-25dc-44d5-9b0e-414185c6bf7c", "name": "network-vif-plugged", "status": "completed", "tag": "62212714-898b-4797-8121-7ff0e3a55c98"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:59:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Creating event network-changed:bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance 61119681-6ec1-4dee-bf91-908f479488d5 on user Apr 14 15:59:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Creating event network-vif-unplugged:62212714-898b-4797-8121-7ff0e3a55c98 for instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c on user Apr 14 15:59:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Creating event network-vif-plugged:62212714-898b-4797-8121-7ff0e3a55c98 for instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c on user Apr 14 15:59:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.040359 Apr 14 15:59:09 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 274/825] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:59:09 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:59:11 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-6b2646ff-735d-4165-a705-130a820faebb req-e3227f5d-4e2e-4aaf-974f-9d608d4a9120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61119681-6ec1-4dee-bf91-908f479488d5", "name": "network-vif-unplugged", "status": "completed", "tag": "bdc45130-027f-49b1-b33a-2a4adbc70f63"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:59:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6b2646ff-735d-4165-a705-130a820faebb req-e3227f5d-4e2e-4aaf-974f-9d608d4a9120 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6b2646ff-735d-4165-a705-130a820faebb req-e3227f5d-4e2e-4aaf-974f-9d608d4a9120 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6b2646ff-735d-4165-a705-130a820faebb req-e3227f5d-4e2e-4aaf-974f-9d608d4a9120 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:11 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-6b2646ff-735d-4165-a705-130a820faebb req-e3227f5d-4e2e-4aaf-974f-9d608d4a9120 service nova] Creating event network-vif-unplugged:bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance 61119681-6ec1-4dee-bf91-908f479488d5 on user Apr 14 15:59:11 user devstack@n-api.service[61876]: DEBUG nova.compute.api [req-6b2646ff-735d-4165-a705-130a820faebb req-e3227f5d-4e2e-4aaf-974f-9d608d4a9120 service nova] Instance 61119681-6ec1-4dee-bf91-908f479488d5 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 15:59:11 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-6b2646ff-735d-4165-a705-130a820faebb req-e3227f5d-4e2e-4aaf-974f-9d608d4a9120 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.320623 Apr 14 15:59:11 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 277/826] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:59:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:59:12 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-4188aff7-df6d-4ac5-9b76-fe2735020b72 req-3c747084-38f7-40c2-8214-d5d39f88bacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4adfa25-25dc-44d5-9b0e-414185c6bf7c", "name": "network-vif-deleted", "tag": "62212714-898b-4797-8121-7ff0e3a55c98"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:59:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-4188aff7-df6d-4ac5-9b76-fe2735020b72 req-3c747084-38f7-40c2-8214-d5d39f88bacc service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-4188aff7-df6d-4ac5-9b76-fe2735020b72 req-3c747084-38f7-40c2-8214-d5d39f88bacc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-4188aff7-df6d-4ac5-9b76-fe2735020b72 req-3c747084-38f7-40c2-8214-d5d39f88bacc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:12 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-4188aff7-df6d-4ac5-9b76-fe2735020b72 req-3c747084-38f7-40c2-8214-d5d39f88bacc service nova] Creating event network-vif-deleted:62212714-898b-4797-8121-7ff0e3a55c98 for instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c on user Apr 14 15:59:12 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-4188aff7-df6d-4ac5-9b76-fe2735020b72 req-3c747084-38f7-40c2-8214-d5d39f88bacc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037986 Apr 14 15:59:12 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 276/827] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:59:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:59:13 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-70332508-2bcc-4eb6-9818-cb187d371e0d req-fbab798a-226a-4e8c-9ed3-267681e246e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61119681-6ec1-4dee-bf91-908f479488d5", "name": "network-vif-plugged", "status": "completed", "tag": "bdc45130-027f-49b1-b33a-2a4adbc70f63"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:59:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-70332508-2bcc-4eb6-9818-cb187d371e0d req-fbab798a-226a-4e8c-9ed3-267681e246e6 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-70332508-2bcc-4eb6-9818-cb187d371e0d req-fbab798a-226a-4e8c-9ed3-267681e246e6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-70332508-2bcc-4eb6-9818-cb187d371e0d req-fbab798a-226a-4e8c-9ed3-267681e246e6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:13 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-70332508-2bcc-4eb6-9818-cb187d371e0d req-fbab798a-226a-4e8c-9ed3-267681e246e6 service nova] Creating event network-vif-plugged:bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance 61119681-6ec1-4dee-bf91-908f479488d5 on user Apr 14 15:59:13 user devstack@n-api.service[61875]: DEBUG nova.compute.api [req-70332508-2bcc-4eb6-9818-cb187d371e0d req-fbab798a-226a-4e8c-9ed3-267681e246e6 service nova] Instance 61119681-6ec1-4dee-bf91-908f479488d5 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 15:59:13 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-70332508-2bcc-4eb6-9818-cb187d371e0d req-fbab798a-226a-4e8c-9ed3-267681e246e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038608 Apr 14 15:59:13 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 275/828] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:59:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:59:21 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:59:21 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=26 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:59:21 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-bee3dc3b-3bbd-4796-a21a-8bc8e416b00a req-6cb449c8-ccb8-43cb-a4ec-a1690b0d78be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61119681-6ec1-4dee-bf91-908f479488d5", "name": "network-vif-plugged", "status": "completed", "tag": "bdc45130-027f-49b1-b33a-2a4adbc70f63"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:59:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-bee3dc3b-3bbd-4796-a21a-8bc8e416b00a req-6cb449c8-ccb8-43cb-a4ec-a1690b0d78be service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-bee3dc3b-3bbd-4796-a21a-8bc8e416b00a req-6cb449c8-ccb8-43cb-a4ec-a1690b0d78be service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-bee3dc3b-3bbd-4796-a21a-8bc8e416b00a req-6cb449c8-ccb8-43cb-a4ec-a1690b0d78be service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-bee3dc3b-3bbd-4796-a21a-8bc8e416b00a req-6cb449c8-ccb8-43cb-a4ec-a1690b0d78be service nova] Creating event network-vif-plugged:bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance 61119681-6ec1-4dee-bf91-908f479488d5 on user Apr 14 15:59:21 user devstack@n-api.service[61876]: DEBUG nova.compute.api [req-bee3dc3b-3bbd-4796-a21a-8bc8e416b00a req-6cb449c8-ccb8-43cb-a4ec-a1690b0d78be service nova] Instance 61119681-6ec1-4dee-bf91-908f479488d5 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 15:59:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-bee3dc3b-3bbd-4796-a21a-8bc8e416b00a req-6cb449c8-ccb8-43cb-a4ec-a1690b0d78be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041807 Apr 14 15:59:21 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 278/829] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:59:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:59:23 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-d1d6feba-38b5-4117-b491-066b150d417b req-2af709ed-ac40-4fbd-83af-655267e453b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61119681-6ec1-4dee-bf91-908f479488d5", "name": "network-vif-plugged", "status": "completed", "tag": "bdc45130-027f-49b1-b33a-2a4adbc70f63"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:59:23 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:59:23 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:59:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-d1d6feba-38b5-4117-b491-066b150d417b req-2af709ed-ac40-4fbd-83af-655267e453b9 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-d1d6feba-38b5-4117-b491-066b150d417b req-2af709ed-ac40-4fbd-83af-655267e453b9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-d1d6feba-38b5-4117-b491-066b150d417b req-2af709ed-ac40-4fbd-83af-655267e453b9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:23 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-d1d6feba-38b5-4117-b491-066b150d417b req-2af709ed-ac40-4fbd-83af-655267e453b9 service nova] Creating event network-vif-plugged:bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance 61119681-6ec1-4dee-bf91-908f479488d5 on user Apr 14 15:59:23 user devstack@n-api.service[61874]: DEBUG nova.compute.api [req-d1d6feba-38b5-4117-b491-066b150d417b req-2af709ed-ac40-4fbd-83af-655267e453b9 service nova] Instance 61119681-6ec1-4dee-bf91-908f479488d5 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61874) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 15:59:23 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-d1d6feba-38b5-4117-b491-066b150d417b req-2af709ed-ac40-4fbd-83af-655267e453b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045317 Apr 14 15:59:23 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 277/830] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:59:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=12 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=30 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6c3288c8-bd32-4df9-8b0b-50db3eded224 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-6c3288c8-bd32-4df9-8b0b-50db3eded224 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6c3288c8-bd32-4df9-8b0b-50db3eded224 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6c3288c8-bd32-4df9-8b0b-50db3eded224 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6c3288c8-bd32-4df9-8b0b-50db3eded224 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6c3288c8-bd32-4df9-8b0b-50db3eded224 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6c3288c8-bd32-4df9-8b0b-50db3eded224 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6c3288c8-bd32-4df9-8b0b-50db3eded224 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:58 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-6c3288c8-bd32-4df9-8b0b-50db3eded224 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] HTTP exception thrown: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6c3288c8-bd32-4df9-8b0b-50db3eded224 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Request method failure captured: Apr 14 15:59:58 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c HTTP/1.1 Apr 14 15:59:58 user devstack@n-api.service[61875]: Accept: application/json Apr 14 15:59:58 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 15:59:58 user devstack@n-api.service[61875]: Connection: close Apr 14 15:59:58 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 15:59:58 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 15:59:58 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 15:59:58 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 15:59:58 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXVP3UHGr2rvLXX6mutfrvTFZcLIKfEdCq92P5izsyNpLCIZfiEnYGqUZ1nd3slCZ3TlBFQ1dvyGPx-amw3QrdbAhCbhWZWqveaP1VkssQMrhXsrqXlHGZ4rGyTekPmLw3z1LXrY9TH8gT4FV_VlO1M0aIFrQtPQnbPR8FYXfym3OQs Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Project-Id: 534f0fb654694b079fa89150594e1bbb Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Project-Name: tempest-AttachVolumeTestJSON-1357089397 Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Tenant: tempest-AttachVolumeTestJSON-1357089397 Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Tenant-Id: 534f0fb654694b079fa89150594e1bbb Apr 14 15:59:58 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1357089397 Apr 14 15:59:58 user devstack@n-api.service[61875]: X-User: tempest-AttachVolumeTestJSON-1357089397-project-member Apr 14 15:59:58 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 15:59:58 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 15:59:58 user devstack@n-api.service[61875]: X-User-Id: b44feacbb8fa4680a965953c122cf31c Apr 14 15:59:58 user devstack@n-api.service[61875]: X-User-Name: tempest-AttachVolumeTestJSON-1357089397-project-member Apr 14 15:59:58 user devstack@n-api.service[61875]: method: > Apr 14 15:59:58 user devstack@n-api.service[61875]: exception: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 15:59:58 user devstack@n-api.service[61875]: action_args: {'id': 'e4adfa25-25dc-44d5-9b0e-414185c6bf7c'} Apr 14 15:59:58 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 15:59:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6c3288c8-bd32-4df9-8b0b-50db3eded224 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Returning 404 to user: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:59:58 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-6c3288c8-bd32-4df9-8b0b-50db3eded224 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c" status: 404 len: 111 microversion: 2.1 time: 0.040216 Apr 14 15:59:58 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 276/831] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:59:58 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:59:58 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:59:58 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:59:58 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-226b44a5-c659-4c46-8e3f-e62e87cba2c1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '.version_select at 0x7f2970848940>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:58 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-226b44a5-c659-4c46-8e3f-e62e87cba2c1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-421873860" status: 202 len: 0 microversion: 2.1 time: 0.031982 Apr 14 15:59:58 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 279/832] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 15:59:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-421873860 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:59:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-aff89a23-65f6-4437-9adf-fbfc2adfeaab tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:58 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-aff89a23-65f6-4437-9adf-fbfc2adfeaab tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:59:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:59:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-aff89a23-65f6-4437-9adf-fbfc2adfeaab tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-aff89a23-65f6-4437-9adf-fbfc2adfeaab tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-aff89a23-65f6-4437-9adf-fbfc2adfeaab tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-aff89a23-65f6-4437-9adf-fbfc2adfeaab tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-aff89a23-65f6-4437-9adf-fbfc2adfeaab tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-aff89a23-65f6-4437-9adf-fbfc2adfeaab tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-47e1d6a3-5d9d-41df-8f26-acb420a6e129 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-47e1d6a3-5d9d-41df-8f26-acb420a6e129 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-47e1d6a3-5d9d-41df-8f26-acb420a6e129 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-47e1d6a3-5d9d-41df-8f26-acb420a6e129 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-47e1d6a3-5d9d-41df-8f26-acb420a6e129 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-47e1d6a3-5d9d-41df-8f26-acb420a6e129 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-47e1d6a3-5d9d-41df-8f26-acb420a6e129 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-47e1d6a3-5d9d-41df-8f26-acb420a6e129 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:58 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-aff89a23-65f6-4437-9adf-fbfc2adfeaab tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:59:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-aff89a23-65f6-4437-9adf-fbfc2adfeaab tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5" status: 200 len: 1552 microversion: 2.1 time: 0.271146 Apr 14 15:59:58 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 278/833] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:59:58 2023] GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 => generated 1552 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:59:59 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-47e1d6a3-5d9d-41df-8f26-acb420a6e129 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.258034 Apr 14 15:59:59 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 277/834] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 15:59:58 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-interface => generated 282 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 15:59:59 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ebde9c7-b620-4553-856c-c6a3429381b6", "tag": "e7e2966b-fc86-47d5-a656-93ba5e362a42"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:59:59 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-d2fe97ab-3f8f-4694-aee7-cc6b0c7dbeca tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:59:59 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-d2fe97ab-3f8f-4694-aee7-cc6b0c7dbeca tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:59:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d2fe97ab-3f8f-4694-aee7-cc6b0c7dbeca tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d2fe97ab-3f8f-4694-aee7-cc6b0c7dbeca tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d2fe97ab-3f8f-4694-aee7-cc6b0c7dbeca tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:59:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d2fe97ab-3f8f-4694-aee7-cc6b0c7dbeca tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:59:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d2fe97ab-3f8f-4694-aee7-cc6b0c7dbeca tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:59:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d2fe97ab-3f8f-4694-aee7-cc6b0c7dbeca tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:00 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] Creating event network-changed:e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 on user Apr 14 16:00:00 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083541 Apr 14 16:00:00 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 280/835] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:59:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:00:00 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-d2fe97ab-3f8f-4694-aee7-cc6b0c7dbeca tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/ips" status: 200 len: 110 microversion: 2.20 time: 0.048023 Apr 14 16:00:00 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 279/836] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 15:59:59 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/ips => generated 110 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:00:02 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:00:02 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:00:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:02 user devstack@n-api.service[61875]: DEBUG nova.objects.instance [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'flavor' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=61875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 16:00:03 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/action" status: 202 len: 0 microversion: 2.20 time: 1.104468 Apr 14 16:00:03 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 278/837] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 16:00:02 2023] POST /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/action => generated 0 bytes in 1107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:00:03 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-a2d623ac-b753-4a55-8fcc-39b5da13aca0 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:00:03 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-a2d623ac-b753-4a55-8fcc-39b5da13aca0 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:00:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a2d623ac-b753-4a55-8fcc-39b5da13aca0 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a2d623ac-b753-4a55-8fcc-39b5da13aca0 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a2d623ac-b753-4a55-8fcc-39b5da13aca0 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a2d623ac-b753-4a55-8fcc-39b5da13aca0 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a2d623ac-b753-4a55-8fcc-39b5da13aca0 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:03 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a2d623ac-b753-4a55-8fcc-39b5da13aca0 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:03 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-a2d623ac-b753-4a55-8fcc-39b5da13aca0 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:00:03 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-a2d623ac-b753-4a55-8fcc-39b5da13aca0 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:00:03 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-a2d623ac-b753-4a55-8fcc-39b5da13aca0 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:00:03 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-a2d623ac-b753-4a55-8fcc-39b5da13aca0 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6" status: 200 len: 1712 microversion: 2.20 time: 0.236707 Apr 14 16:00:03 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 281/838] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:00:03 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 => generated 1712 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:00:04 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-d6b64ede-4d9e-4a09-bed9-8c63ac9082da req-8f43e0f8-ab01-4ea3-9a34-dab42773d94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebde9c7-b620-4553-856c-c6a3429381b6", "name": "network-vif-unplugged", "status": "completed", "tag": "e7e2966b-fc86-47d5-a656-93ba5e362a42"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:00:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-d6b64ede-4d9e-4a09-bed9-8c63ac9082da req-8f43e0f8-ab01-4ea3-9a34-dab42773d94a service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-d6b64ede-4d9e-4a09-bed9-8c63ac9082da req-8f43e0f8-ab01-4ea3-9a34-dab42773d94a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-d6b64ede-4d9e-4a09-bed9-8c63ac9082da req-8f43e0f8-ab01-4ea3-9a34-dab42773d94a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:04 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-d6b64ede-4d9e-4a09-bed9-8c63ac9082da req-8f43e0f8-ab01-4ea3-9a34-dab42773d94a service nova] Creating event network-vif-unplugged:e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 on user Apr 14 16:00:04 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-d6b64ede-4d9e-4a09-bed9-8c63ac9082da req-8f43e0f8-ab01-4ea3-9a34-dab42773d94a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046761 Apr 14 16:00:04 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 280/839] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:00:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:00:05 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-2d6822de-19a4-474f-9cf6-a79c57d039f7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:00:05 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-2d6822de-19a4-474f-9cf6-a79c57d039f7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:00:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2d6822de-19a4-474f-9cf6-a79c57d039f7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2d6822de-19a4-474f-9cf6-a79c57d039f7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2d6822de-19a4-474f-9cf6-a79c57d039f7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2d6822de-19a4-474f-9cf6-a79c57d039f7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2d6822de-19a4-474f-9cf6-a79c57d039f7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-2d6822de-19a4-474f-9cf6-a79c57d039f7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:05 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-2d6822de-19a4-474f-9cf6-a79c57d039f7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] HTTP exception thrown: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 16:00:05 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-2d6822de-19a4-474f-9cf6-a79c57d039f7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Request method failure captured: Apr 14 16:00:05 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c HTTP/1.1 Apr 14 16:00:05 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:00:05 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:00:05 user devstack@n-api.service[61875]: Connection: close Apr 14 16:00:05 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:00:05 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:00:05 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:00:05 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:00:05 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXVP3UHGr2rvLXX6mutfrvTFZcLIKfEdCq92P5izsyNpLCIZfiEnYGqUZ1nd3slCZ3TlBFQ1dvyGPx-amw3QrdbAhCbhWZWqveaP1VkssQMrhXsrqXlHGZ4rGyTekPmLw3z1LXrY9TH8gT4FV_VlO1M0aIFrQtPQnbPR8FYXfym3OQs Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Project-Id: 534f0fb654694b079fa89150594e1bbb Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Project-Name: tempest-AttachVolumeTestJSON-1357089397 Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Tenant: tempest-AttachVolumeTestJSON-1357089397 Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Tenant-Id: 534f0fb654694b079fa89150594e1bbb Apr 14 16:00:05 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1357089397 Apr 14 16:00:05 user devstack@n-api.service[61875]: X-User: tempest-AttachVolumeTestJSON-1357089397-project-member Apr 14 16:00:05 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:00:05 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:00:05 user devstack@n-api.service[61875]: X-User-Id: b44feacbb8fa4680a965953c122cf31c Apr 14 16:00:05 user devstack@n-api.service[61875]: X-User-Name: tempest-AttachVolumeTestJSON-1357089397-project-member Apr 14 16:00:05 user devstack@n-api.service[61875]: method: > Apr 14 16:00:05 user devstack@n-api.service[61875]: exception: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 16:00:05 user devstack@n-api.service[61875]: action_args: {'id': 'e4adfa25-25dc-44d5-9b0e-414185c6bf7c'} Apr 14 16:00:05 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 16:00:05 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:00:05 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-2d6822de-19a4-474f-9cf6-a79c57d039f7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Returning 404 to user: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:00:05 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-2d6822de-19a4-474f-9cf6-a79c57d039f7 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c" status: 404 len: 111 microversion: 2.1 time: 0.030926 Apr 14 16:00:05 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 279/840] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:00:05 2023] DELETE /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:00:05 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-81b41c05-c4eb-454f-bcdf-5cf2063cbd01 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:00:05 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-81b41c05-c4eb-454f-bcdf-5cf2063cbd01 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:00:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-81b41c05-c4eb-454f-bcdf-5cf2063cbd01 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-81b41c05-c4eb-454f-bcdf-5cf2063cbd01 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-81b41c05-c4eb-454f-bcdf-5cf2063cbd01 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-81b41c05-c4eb-454f-bcdf-5cf2063cbd01 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-81b41c05-c4eb-454f-bcdf-5cf2063cbd01 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-81b41c05-c4eb-454f-bcdf-5cf2063cbd01 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:05 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-81b41c05-c4eb-454f-bcdf-5cf2063cbd01 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] HTTP exception thrown: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 16:00:05 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-81b41c05-c4eb-454f-bcdf-5cf2063cbd01 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Request method failure captured: Apr 14 16:00:05 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c HTTP/1.1 Apr 14 16:00:05 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:00:05 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:00:05 user devstack@n-api.service[61876]: Connection: close Apr 14 16:00:05 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:00:05 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:00:05 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:00:05 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:00:05 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXVP3UHGr2rvLXX6mutfrvTFZcLIKfEdCq92P5izsyNpLCIZfiEnYGqUZ1nd3slCZ3TlBFQ1dvyGPx-amw3QrdbAhCbhWZWqveaP1VkssQMrhXsrqXlHGZ4rGyTekPmLw3z1LXrY9TH8gT4FV_VlO1M0aIFrQtPQnbPR8FYXfym3OQs Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Project-Id: 534f0fb654694b079fa89150594e1bbb Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Project-Name: tempest-AttachVolumeTestJSON-1357089397 Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Tenant: tempest-AttachVolumeTestJSON-1357089397 Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Tenant-Id: 534f0fb654694b079fa89150594e1bbb Apr 14 16:00:05 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1357089397 Apr 14 16:00:05 user devstack@n-api.service[61876]: X-User: tempest-AttachVolumeTestJSON-1357089397-project-member Apr 14 16:00:05 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:00:05 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:00:05 user devstack@n-api.service[61876]: X-User-Id: b44feacbb8fa4680a965953c122cf31c Apr 14 16:00:05 user devstack@n-api.service[61876]: X-User-Name: tempest-AttachVolumeTestJSON-1357089397-project-member Apr 14 16:00:05 user devstack@n-api.service[61876]: method: > Apr 14 16:00:05 user devstack@n-api.service[61876]: exception: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 16:00:05 user devstack@n-api.service[61876]: action_args: {'id': 'e4adfa25-25dc-44d5-9b0e-414185c6bf7c'} Apr 14 16:00:05 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. Apr 14 16:00:05 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:00:05 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-81b41c05-c4eb-454f-bcdf-5cf2063cbd01 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Returning 404 to user: Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:00:05 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-81b41c05-c4eb-454f-bcdf-5cf2063cbd01 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c" status: 404 len: 111 microversion: 2.1 time: 0.047086 Apr 14 16:00:05 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 282/841] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:00:05 2023] GET /compute/v2.1/servers/e4adfa25-25dc-44d5-9b0e-414185c6bf7c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 16:00:06 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-9b4db6b1-c712-4721-afef-7fc2988e374e req-f31538a9-df36-4a89-9efb-5ce9c2a8b479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebde9c7-b620-4553-856c-c6a3429381b6", "name": "network-vif-plugged", "status": "completed", "tag": "e7e2966b-fc86-47d5-a656-93ba5e362a42"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:00:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9b4db6b1-c712-4721-afef-7fc2988e374e req-f31538a9-df36-4a89-9efb-5ce9c2a8b479 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9b4db6b1-c712-4721-afef-7fc2988e374e req-f31538a9-df36-4a89-9efb-5ce9c2a8b479 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:06 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9b4db6b1-c712-4721-afef-7fc2988e374e req-f31538a9-df36-4a89-9efb-5ce9c2a8b479 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:06 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-9b4db6b1-c712-4721-afef-7fc2988e374e req-f31538a9-df36-4a89-9efb-5ce9c2a8b479 service nova] Creating event network-vif-plugged:e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 on user Apr 14 16:00:06 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-9b4db6b1-c712-4721-afef-7fc2988e374e req-f31538a9-df36-4a89-9efb-5ce9c2a8b479 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036851 Apr 14 16:00:06 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 281/842] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:00:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:00:08 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b85657b8-9add-4b28-ad73-1bc03f6514c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:00:08 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-b85657b8-9add-4b28-ad73-1bc03f6514c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:00:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b85657b8-9add-4b28-ad73-1bc03f6514c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b85657b8-9add-4b28-ad73-1bc03f6514c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b85657b8-9add-4b28-ad73-1bc03f6514c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b85657b8-9add-4b28-ad73-1bc03f6514c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b85657b8-9add-4b28-ad73-1bc03f6514c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b85657b8-9add-4b28-ad73-1bc03f6514c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:08 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-b85657b8-9add-4b28-ad73-1bc03f6514c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] HTTP exception thrown: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 16:00:08 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b85657b8-9add-4b28-ad73-1bc03f6514c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Request method failure captured: Apr 14 16:00:08 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 HTTP/1.1 Apr 14 16:00:08 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:00:08 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:00:08 user devstack@n-api.service[61875]: Connection: close Apr 14 16:00:08 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:00:08 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:00:08 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:00:08 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:00:08 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXVP3UHGr2rvLXX6mutfrvTFZcLIKfEdCq92P5izsyNpLCIZfiEnYGqUZ1nd3slCZ3TlBFQ1dvyGPx-amw3QrdbAhCbhWZWqveaP1VkssQMrhXsrqXlHGZ4rGyTekPmLw3z1LXrY9TH8gT4FV_VlO1M0aIFrQtPQnbPR8FYXfym3OQs Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Project-Id: 534f0fb654694b079fa89150594e1bbb Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Project-Name: tempest-AttachVolumeTestJSON-1357089397 Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Tenant: tempest-AttachVolumeTestJSON-1357089397 Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Tenant-Id: 534f0fb654694b079fa89150594e1bbb Apr 14 16:00:08 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1357089397 Apr 14 16:00:08 user devstack@n-api.service[61875]: X-User: tempest-AttachVolumeTestJSON-1357089397-project-member Apr 14 16:00:08 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:00:08 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:00:08 user devstack@n-api.service[61875]: X-User-Id: b44feacbb8fa4680a965953c122cf31c Apr 14 16:00:08 user devstack@n-api.service[61875]: X-User-Name: tempest-AttachVolumeTestJSON-1357089397-project-member Apr 14 16:00:08 user devstack@n-api.service[61875]: method: > Apr 14 16:00:08 user devstack@n-api.service[61875]: exception: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 16:00:08 user devstack@n-api.service[61875]: action_args: {'id': 'd4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297'} Apr 14 16:00:08 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 16:00:08 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:00:08 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b85657b8-9add-4b28-ad73-1bc03f6514c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Returning 404 to user: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:00:08 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-b85657b8-9add-4b28-ad73-1bc03f6514c4 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 404 len: 111 microversion: 2.1 time: 0.053330 Apr 14 16:00:08 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 280/843] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:00:08 2023] DELETE /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:00:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-30c8b6d3-4e40-4c72-b602-f4d8bdbfd662 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:00:08 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-30c8b6d3-4e40-4c72-b602-f4d8bdbfd662 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:00:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-30c8b6d3-4e40-4c72-b602-f4d8bdbfd662 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-30c8b6d3-4e40-4c72-b602-f4d8bdbfd662 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-30c8b6d3-4e40-4c72-b602-f4d8bdbfd662 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-30c8b6d3-4e40-4c72-b602-f4d8bdbfd662 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-30c8b6d3-4e40-4c72-b602-f4d8bdbfd662 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-30c8b6d3-4e40-4c72-b602-f4d8bdbfd662 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-30c8b6d3-4e40-4c72-b602-f4d8bdbfd662 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] HTTP exception thrown: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 16:00:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-30c8b6d3-4e40-4c72-b602-f4d8bdbfd662 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Request method failure captured: Apr 14 16:00:08 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 HTTP/1.1 Apr 14 16:00:08 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:00:08 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:00:08 user devstack@n-api.service[61876]: Connection: close Apr 14 16:00:08 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:00:08 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:00:08 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:00:08 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:00:08 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXVP3UHGr2rvLXX6mutfrvTFZcLIKfEdCq92P5izsyNpLCIZfiEnYGqUZ1nd3slCZ3TlBFQ1dvyGPx-amw3QrdbAhCbhWZWqveaP1VkssQMrhXsrqXlHGZ4rGyTekPmLw3z1LXrY9TH8gT4FV_VlO1M0aIFrQtPQnbPR8FYXfym3OQs Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Project-Id: 534f0fb654694b079fa89150594e1bbb Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Project-Name: tempest-AttachVolumeTestJSON-1357089397 Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/534f0fb654694b079fa89150594e1bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Tenant: tempest-AttachVolumeTestJSON-1357089397 Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Tenant-Id: 534f0fb654694b079fa89150594e1bbb Apr 14 16:00:08 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1357089397 Apr 14 16:00:08 user devstack@n-api.service[61876]: X-User: tempest-AttachVolumeTestJSON-1357089397-project-member Apr 14 16:00:08 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:00:08 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:00:08 user devstack@n-api.service[61876]: X-User-Id: b44feacbb8fa4680a965953c122cf31c Apr 14 16:00:08 user devstack@n-api.service[61876]: X-User-Name: tempest-AttachVolumeTestJSON-1357089397-project-member Apr 14 16:00:08 user devstack@n-api.service[61876]: method: > Apr 14 16:00:08 user devstack@n-api.service[61876]: exception: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 16:00:08 user devstack@n-api.service[61876]: action_args: {'id': 'd4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297'} Apr 14 16:00:08 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. Apr 14 16:00:08 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:00:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-30c8b6d3-4e40-4c72-b602-f4d8bdbfd662 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Returning 404 to user: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:00:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-30c8b6d3-4e40-4c72-b602-f4d8bdbfd662 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" status: 404 len: 111 microversion: 2.1 time: 0.047646 Apr 14 16:00:08 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 283/844] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:00:08 2023] GET /compute/v2.1/servers/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:00:09 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ebde9c7-b620-4553-856c-c6a3429381b6", "tag": "e7e2966b-fc86-47d5-a656-93ba5e362a42"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:00:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] Creating event network-changed:e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 on user Apr 14 16:00:09 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076206 Apr 14 16:00:09 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 282/845] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:00:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:00:19 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=10 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:19 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:19 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-edd4c034-bde1-4245-8d83-6a77605eb1c3 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Action: 'create', calling method: .version_select at 0x7f2970a8a200>, body: {"keypair": {"name": "tempest-keypair-93023126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjVuDJ9xVPhnnLm/KZI4BtaCidawIWOhzsM+GSCcr5RyxUk8iD3KwA1Gn1HZBT7OTGIJhfgbWgRizhDxCyb0Dz9e/HVM531L20H+msWPOYrdB5AlRgWeT92c2o/9OGjPg=="}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:00:19 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-edd4c034-bde1-4245-8d83-6a77605eb1c3 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for project ecb4d204dbf24c19b978456d16d19e87. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:00:19 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-edd4c034-bde1-4245-8d83-6a77605eb1c3 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for user 2d83796cd8d5464fa4e580844441da81 and project ecb4d204dbf24c19b978456d16d19e87. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:00:19 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-edd4c034-bde1-4245-8d83-6a77605eb1c3 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.156384 Apr 14 16:00:19 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 281/846] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 16:00:19 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:00:20 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-600730661", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "5deec755-9819-4003-820a-2b9360f5dc62"}], "security_groups": [{"name": "tempest-securitygroup--406013226"}], "key_name": "tempest-keypair-93023126", "user_data": "}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:00:20 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:20 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=12 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] validate_networks() for [('5deec755-9819-4003-820a-2b9360f5dc62', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for project ecb4d204dbf24c19b978456d16d19e87. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for user 2d83796cd8d5464fa4e580844441da81 and project ecb4d204dbf24c19b978456d16d19e87. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:00:21 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:00:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.657116 Apr 14 16:00:21 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 284/847] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:00:20 2023] POST /compute/v2.1/servers => generated 399 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:00:21 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-719e20d6-1869-41e0-b161-47433dcb8ff4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:00:21 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-719e20d6-1869-41e0-b161-47433dcb8ff4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:00:21 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=10 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:21 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=16 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:21 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-719e20d6-1869-41e0-b161-47433dcb8ff4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:00:21 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-719e20d6-1869-41e0-b161-47433dcb8ff4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff" status: 200 len: 1233 microversion: 2.1 time: 0.086615 Apr 14 16:00:21 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 283/848] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:00:21 2023] GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:00:24 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85ad8a8f-d9e8-4f74-a16f-449616e970ff", "tag": "32081ce5-b63b-4a2d-9150-5c4d235a8b28"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:00:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] Creating event network-changed:32081ce5-b63b-4a2d-9150-5c4d235a8b28 for instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff on user Apr 14 16:00:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030195 Apr 14 16:00:24 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 282/849] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:00:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:00:26 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-77fdf9ff-34eb-40dc-babc-1ec879fc8711 req-fd6ba30f-ca5a-4392-a0c7-af66ad64a3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85ad8a8f-d9e8-4f74-a16f-449616e970ff", "name": "network-vif-plugged", "status": "completed", "tag": "32081ce5-b63b-4a2d-9150-5c4d235a8b28"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:00:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-77fdf9ff-34eb-40dc-babc-1ec879fc8711 req-fd6ba30f-ca5a-4392-a0c7-af66ad64a3a5 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-77fdf9ff-34eb-40dc-babc-1ec879fc8711 req-fd6ba30f-ca5a-4392-a0c7-af66ad64a3a5 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:26 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-77fdf9ff-34eb-40dc-babc-1ec879fc8711 req-fd6ba30f-ca5a-4392-a0c7-af66ad64a3a5 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:26 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-77fdf9ff-34eb-40dc-babc-1ec879fc8711 req-fd6ba30f-ca5a-4392-a0c7-af66ad64a3a5 service nova] Creating event network-vif-plugged:32081ce5-b63b-4a2d-9150-5c4d235a8b28 for instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff on user Apr 14 16:00:26 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-77fdf9ff-34eb-40dc-babc-1ec879fc8711 req-fd6ba30f-ca5a-4392-a0c7-af66ad64a3a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036570 Apr 14 16:00:26 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 285/850] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:00:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:00:28 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-db777d64-21e8-4da5-817c-c51b25816233 req-7528d496-6b45-4764-95ef-2f08d4886f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85ad8a8f-d9e8-4f74-a16f-449616e970ff", "name": "network-vif-plugged", "status": "completed", "tag": "32081ce5-b63b-4a2d-9150-5c4d235a8b28"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:00:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-db777d64-21e8-4da5-817c-c51b25816233 req-7528d496-6b45-4764-95ef-2f08d4886f72 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-db777d64-21e8-4da5-817c-c51b25816233 req-7528d496-6b45-4764-95ef-2f08d4886f72 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-db777d64-21e8-4da5-817c-c51b25816233 req-7528d496-6b45-4764-95ef-2f08d4886f72 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:28 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-db777d64-21e8-4da5-817c-c51b25816233 req-7528d496-6b45-4764-95ef-2f08d4886f72 service nova] Creating event network-vif-plugged:32081ce5-b63b-4a2d-9150-5c4d235a8b28 for instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff on user Apr 14 16:00:28 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-db777d64-21e8-4da5-817c-c51b25816233 req-7528d496-6b45-4764-95ef-2f08d4886f72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030960 Apr 14 16:00:28 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 284/851] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:00:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-fc46b55c-7300-4251-ba69-373cd401e0d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-fc46b55c-7300-4251-ba69-373cd401e0d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fc46b55c-7300-4251-ba69-373cd401e0d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fc46b55c-7300-4251-ba69-373cd401e0d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fc46b55c-7300-4251-ba69-373cd401e0d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fc46b55c-7300-4251-ba69-373cd401e0d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fc46b55c-7300-4251-ba69-373cd401e0d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fc46b55c-7300-4251-ba69-373cd401e0d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-fc46b55c-7300-4251-ba69-373cd401e0d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-fc46b55c-7300-4251-ba69-373cd401e0d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:00:54 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-fc46b55c-7300-4251-ba69-373cd401e0d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:00:54 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-fc46b55c-7300-4251-ba69-373cd401e0d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6" status: 200 len: 1653 microversion: 2.20 time: 0.381414 Apr 14 16:00:54 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 283/852] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:00:54 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 => generated 1653 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:00:58 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:58 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:58 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:58 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:58 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:00:58 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:00:58 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:58 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:58 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:58 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:58 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:58 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:58 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "POST /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5/action" status: 204 len: 0 microversion: 2.1 time: 0.078943 Apr 14 16:00:58 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 286/853] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 16:00:58 2023] POST /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:00:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-d82aa960-aa05-48ee-94f4-d719b1a3e884 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:00:58 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-d82aa960-aa05-48ee-94f4-d719b1a3e884 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:00:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:00:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d82aa960-aa05-48ee-94f4-d719b1a3e884 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d82aa960-aa05-48ee-94f4-d719b1a3e884 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d82aa960-aa05-48ee-94f4-d719b1a3e884 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d82aa960-aa05-48ee-94f4-d719b1a3e884 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:00:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d82aa960-aa05-48ee-94f4-d719b1a3e884 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:00:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-d82aa960-aa05-48ee-94f4-d719b1a3e884 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:00:59 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-d82aa960-aa05-48ee-94f4-d719b1a3e884 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:00:59 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-d82aa960-aa05-48ee-94f4-d719b1a3e884 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5" status: 200 len: 1552 microversion: 2.1 time: 0.342441 Apr 14 16:00:59 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 285/854] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:00:58 2023] GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 => generated 1552 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:01:11 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:01:11 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:01:11 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-647694ce-863d-4e45-b799-4405eda4f01e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:01:11 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-647694ce-863d-4e45-b799-4405eda4f01e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:01:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-647694ce-863d-4e45-b799-4405eda4f01e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:01:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-647694ce-863d-4e45-b799-4405eda4f01e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:01:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-647694ce-863d-4e45-b799-4405eda4f01e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:01:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-647694ce-863d-4e45-b799-4405eda4f01e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:01:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-647694ce-863d-4e45-b799-4405eda4f01e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:01:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-647694ce-863d-4e45-b799-4405eda4f01e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:01:11 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-647694ce-863d-4e45-b799-4405eda4f01e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:01:11 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-647694ce-863d-4e45-b799-4405eda4f01e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff" status: 200 len: 1542 microversion: 2.1 time: 0.227125 Apr 14 16:01:11 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 284/855] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:01:11 2023] GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff => generated 1542 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:01:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:01:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:01:49 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-a093bcba-fb2f-4743-aee4-b6e35e90ff36 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:01:49 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-a093bcba-fb2f-4743-aee4-b6e35e90ff36 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:01:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a093bcba-fb2f-4743-aee4-b6e35e90ff36 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:01:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a093bcba-fb2f-4743-aee4-b6e35e90ff36 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:01:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a093bcba-fb2f-4743-aee4-b6e35e90ff36 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:01:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a093bcba-fb2f-4743-aee4-b6e35e90ff36 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:01:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a093bcba-fb2f-4743-aee4-b6e35e90ff36 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:01:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a093bcba-fb2f-4743-aee4-b6e35e90ff36 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:01:49 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-a093bcba-fb2f-4743-aee4-b6e35e90ff36 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:01:49 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-a093bcba-fb2f-4743-aee4-b6e35e90ff36 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5" status: 200 len: 1544 microversion: 2.1 time: 0.251935 Apr 14 16:01:49 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 287/856] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:01:49 2023] GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 => generated 1544 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:01:54 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-9b3dd953-5e16-4d81-aa08-e04107afe38b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72849de7-745e-4d68-b29a-1c64779bbc48"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:01:54 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-9b3dd953-5e16-4d81-aa08-e04107afe38b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:01:54 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:01:54 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:01:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9b3dd953-5e16-4d81-aa08-e04107afe38b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:01:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9b3dd953-5e16-4d81-aa08-e04107afe38b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:01:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9b3dd953-5e16-4d81-aa08-e04107afe38b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:01:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9b3dd953-5e16-4d81-aa08-e04107afe38b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:01:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9b3dd953-5e16-4d81-aa08-e04107afe38b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:01:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9b3dd953-5e16-4d81-aa08-e04107afe38b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:01:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-9b3dd953-5e16-4d81-aa08-e04107afe38b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341593 Apr 14 16:01:54 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 286/857] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 16:01:54 2023] POST /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-volume_attachments => generated 188 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:01:54 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:01:54 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:01:54 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:01:54 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:01:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:01:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:01:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:01:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:01:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:01:54 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:01:55 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61875) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 16:01:55 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/action" status: 202 len: 0 microversion: 2.20 time: 0.193700 Apr 14 16:01:55 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 285/858] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 16:01:54 2023] POST /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:01:55 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-7c940d9c-bc69-40a4-9491-a0de0f87f718 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:01:55 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-7c940d9c-bc69-40a4-9491-a0de0f87f718 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:01:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c940d9c-bc69-40a4-9491-a0de0f87f718 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:01:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c940d9c-bc69-40a4-9491-a0de0f87f718 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:01:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c940d9c-bc69-40a4-9491-a0de0f87f718 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:01:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c940d9c-bc69-40a4-9491-a0de0f87f718 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:01:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c940d9c-bc69-40a4-9491-a0de0f87f718 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:01:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c940d9c-bc69-40a4-9491-a0de0f87f718 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:01:55 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-7c940d9c-bc69-40a4-9491-a0de0f87f718 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:01:55 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-7c940d9c-bc69-40a4-9491-a0de0f87f718 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:01:55 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-7c940d9c-bc69-40a4-9491-a0de0f87f718 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:01:55 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-7c940d9c-bc69-40a4-9491-a0de0f87f718 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6" status: 200 len: 1739 microversion: 2.20 time: 0.240595 Apr 14 16:01:55 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 288/859] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:01:55 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:02:02 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ebde9c7-b620-4553-856c-c6a3429381b6", "tag": "e7e2966b-fc86-47d5-a656-93ba5e362a42"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:02:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:02 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] Creating event network-changed:e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 on user Apr 14 16:02:02 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030941 Apr 14 16:02:02 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 287/860] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:02:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:02:09 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:09 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:09 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-38e9aaa1-5c79-4b53-973b-141c59d78fad req-9f2729a3-0ff6-40df-af3e-a8d6832b6d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebde9c7-b620-4553-856c-c6a3429381b6", "name": "network-vif-plugged", "status": "completed", "tag": "e7e2966b-fc86-47d5-a656-93ba5e362a42"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:02:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-38e9aaa1-5c79-4b53-973b-141c59d78fad req-9f2729a3-0ff6-40df-af3e-a8d6832b6d9d service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-38e9aaa1-5c79-4b53-973b-141c59d78fad req-9f2729a3-0ff6-40df-af3e-a8d6832b6d9d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:09 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-38e9aaa1-5c79-4b53-973b-141c59d78fad req-9f2729a3-0ff6-40df-af3e-a8d6832b6d9d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-38e9aaa1-5c79-4b53-973b-141c59d78fad req-9f2729a3-0ff6-40df-af3e-a8d6832b6d9d service nova] Creating event network-vif-plugged:e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 on user Apr 14 16:02:09 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-38e9aaa1-5c79-4b53-973b-141c59d78fad req-9f2729a3-0ff6-40df-af3e-a8d6832b6d9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044373 Apr 14 16:02:09 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 286/861] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:02:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:02:11 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-9a44000f-4b00-4ee7-acdf-df5b20ca0c0f req-aebf2e77-20cd-4549-9b27-d773a1ec7fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebde9c7-b620-4553-856c-c6a3429381b6", "name": "network-vif-plugged", "status": "completed", "tag": "e7e2966b-fc86-47d5-a656-93ba5e362a42"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:02:11 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:11 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=12 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9a44000f-4b00-4ee7-acdf-df5b20ca0c0f req-aebf2e77-20cd-4549-9b27-d773a1ec7fe8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9a44000f-4b00-4ee7-acdf-df5b20ca0c0f req-aebf2e77-20cd-4549-9b27-d773a1ec7fe8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:11 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9a44000f-4b00-4ee7-acdf-df5b20ca0c0f req-aebf2e77-20cd-4549-9b27-d773a1ec7fe8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:11 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-9a44000f-4b00-4ee7-acdf-df5b20ca0c0f req-aebf2e77-20cd-4549-9b27-d773a1ec7fe8 service nova] Creating event network-vif-plugged:e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 on user Apr 14 16:02:11 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-9a44000f-4b00-4ee7-acdf-df5b20ca0c0f req-aebf2e77-20cd-4549-9b27-d773a1ec7fe8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039675 Apr 14 16:02:11 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 289/862] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:02:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:02:12 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:12 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-a0dd5b32-feb5-4ce2-8733-d75efbe73770 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:02:12 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-a0dd5b32-feb5-4ce2-8733-d75efbe73770 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:02:12 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a0dd5b32-feb5-4ce2-8733-d75efbe73770 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a0dd5b32-feb5-4ce2-8733-d75efbe73770 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a0dd5b32-feb5-4ce2-8733-d75efbe73770 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a0dd5b32-feb5-4ce2-8733-d75efbe73770 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a0dd5b32-feb5-4ce2-8733-d75efbe73770 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:12 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a0dd5b32-feb5-4ce2-8733-d75efbe73770 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:12 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-a0dd5b32-feb5-4ce2-8733-d75efbe73770 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.179859 Apr 14 16:02:12 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 288/863] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 16:02:12 2023] GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff/os-interface => generated 282 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:02:13 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85ad8a8f-d9e8-4f74-a16f-449616e970ff", "tag": "32081ce5-b63b-4a2d-9150-5c4d235a8b28"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:02:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:13 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] Creating event network-changed:32081ce5-b63b-4a2d-9150-5c4d235a8b28 for instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff on user Apr 14 16:02:13 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033684 Apr 14 16:02:13 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 287/864] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:02:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:02:13 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-300a350a-6331-4422-9cd1-57dcac30efd5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:02:13 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-300a350a-6331-4422-9cd1-57dcac30efd5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:02:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-300a350a-6331-4422-9cd1-57dcac30efd5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-300a350a-6331-4422-9cd1-57dcac30efd5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-300a350a-6331-4422-9cd1-57dcac30efd5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-300a350a-6331-4422-9cd1-57dcac30efd5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-300a350a-6331-4422-9cd1-57dcac30efd5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-300a350a-6331-4422-9cd1-57dcac30efd5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:13 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-300a350a-6331-4422-9cd1-57dcac30efd5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff/ips" status: 200 len: 108 microversion: 2.1 time: 0.038898 Apr 14 16:02:13 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 290/865] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 16:02:13 2023] GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff/ips => generated 108 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:02:15 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb5d8c5d-23ea-40c7-a2de-43e2f431182f"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:02:15 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:02:15 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:15 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:15 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:15 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:15 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:15 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:15 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250980 Apr 14 16:02:15 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 289/866] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 16:02:15 2023] POST /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:02:23 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:23 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:23 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6d5d0518-b2ad-4c22-8180-eccb9dc76891 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Action: 'create', calling method: .version_select at 0x7f2970a8b640>, body: {"keypair": {"name": "tempest-keypair-793451587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP40xKD98ur0kI+V9xCaxcG20cmbjfHaAwXYdpSj9TibVs8Trhq6MTZRboRCwgFgCFz8qlbNUrAixLlDFRKHxCUZ99Xx1wesGKZNfuWpJeYp/JNKnj6tX64wTpYmZAA/+A=="}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:02:23 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-6d5d0518-b2ad-4c22-8180-eccb9dc76891 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for project ecb4d204dbf24c19b978456d16d19e87. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:02:23 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-6d5d0518-b2ad-4c22-8180-eccb9dc76891 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for user 2d83796cd8d5464fa4e580844441da81 and project ecb4d204dbf24c19b978456d16d19e87. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:02:23 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-6d5d0518-b2ad-4c22-8180-eccb9dc76891 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053967 Apr 14 16:02:23 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 288/867] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 16:02:23 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:02:24 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1992413246", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "5deec755-9819-4003-820a-2b9360f5dc62"}], "security_groups": [{"name": "tempest-securitygroup--952634361"}], "key_name": "tempest-keypair-793451587", "user_data": "}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:02:24 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:24 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] validate_networks() for [('5deec755-9819-4003-820a-2b9360f5dc62', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for project ecb4d204dbf24c19b978456d16d19e87. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for user 2d83796cd8d5464fa4e580844441da81 and project ecb4d204dbf24c19b978456d16d19e87. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:02:25 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:02:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.816765 Apr 14 16:02:25 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 291/868] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:02:24 2023] POST /compute/v2.1/servers => generated 399 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:02:25 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-a7b9692b-cc3f-4775-8e97-ad4adcf116fb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:02:25 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-a7b9692b-cc3f-4775-8e97-ad4adcf116fb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:02:25 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:25 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-a7b9692b-cc3f-4775-8e97-ad4adcf116fb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:02:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-a7b9692b-cc3f-4775-8e97-ad4adcf116fb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e" status: 200 len: 1235 microversion: 2.1 time: 0.072217 Apr 14 16:02:25 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 290/869] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:02:25 2023] GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e => generated 1235 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:02:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f624c54-a234-49d3-9e25-a69043cffd3e", "tag": "590df74f-db91-4c1b-afb0-0ffce71bb462"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:02:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] Creating event network-changed:590df74f-db91-4c1b-afb0-0ffce71bb462 for instance 9f624c54-a234-49d3-9e25-a69043cffd3e on user Apr 14 16:02:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031840 Apr 14 16:02:28 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 289/870] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:02:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:02:30 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-388166aa-3b94-4ec3-a3a4-fdc9a501e988 req-d9f9c052-738e-436b-806c-634763147317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f624c54-a234-49d3-9e25-a69043cffd3e", "name": "network-vif-plugged", "status": "completed", "tag": "590df74f-db91-4c1b-afb0-0ffce71bb462"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:02:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-388166aa-3b94-4ec3-a3a4-fdc9a501e988 req-d9f9c052-738e-436b-806c-634763147317 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-388166aa-3b94-4ec3-a3a4-fdc9a501e988 req-d9f9c052-738e-436b-806c-634763147317 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-388166aa-3b94-4ec3-a3a4-fdc9a501e988 req-d9f9c052-738e-436b-806c-634763147317 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:30 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-388166aa-3b94-4ec3-a3a4-fdc9a501e988 req-d9f9c052-738e-436b-806c-634763147317 service nova] Creating event network-vif-plugged:590df74f-db91-4c1b-afb0-0ffce71bb462 for instance 9f624c54-a234-49d3-9e25-a69043cffd3e on user Apr 14 16:02:30 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-388166aa-3b94-4ec3-a3a4-fdc9a501e988 req-d9f9c052-738e-436b-806c-634763147317 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033485 Apr 14 16:02:30 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 292/871] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:02:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:02:32 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-639cc854-ce6d-4795-9d7e-9d75ec171122 req-dc7f6285-43a1-4562-acca-0567854827f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f624c54-a234-49d3-9e25-a69043cffd3e", "name": "network-vif-plugged", "status": "completed", "tag": "590df74f-db91-4c1b-afb0-0ffce71bb462"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:02:32 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-639cc854-ce6d-4795-9d7e-9d75ec171122 req-dc7f6285-43a1-4562-acca-0567854827f3 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-639cc854-ce6d-4795-9d7e-9d75ec171122 req-dc7f6285-43a1-4562-acca-0567854827f3 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-639cc854-ce6d-4795-9d7e-9d75ec171122 req-dc7f6285-43a1-4562-acca-0567854827f3 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:32 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-639cc854-ce6d-4795-9d7e-9d75ec171122 req-dc7f6285-43a1-4562-acca-0567854827f3 service nova] Creating event network-vif-plugged:590df74f-db91-4c1b-afb0-0ffce71bb462 for instance 9f624c54-a234-49d3-9e25-a69043cffd3e on user Apr 14 16:02:32 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-639cc854-ce6d-4795-9d7e-9d75ec171122 req-dc7f6285-43a1-4562-acca-0567854827f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034501 Apr 14 16:02:32 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 291/872] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:02:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3076d855-50a4-4ad5-90a9-98a0d58eac20 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-3076d855-50a4-4ad5-90a9-98a0d58eac20 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3076d855-50a4-4ad5-90a9-98a0d58eac20 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3076d855-50a4-4ad5-90a9-98a0d58eac20 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3076d855-50a4-4ad5-90a9-98a0d58eac20 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3076d855-50a4-4ad5-90a9-98a0d58eac20 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3076d855-50a4-4ad5-90a9-98a0d58eac20 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3076d855-50a4-4ad5-90a9-98a0d58eac20 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-3076d855-50a4-4ad5-90a9-98a0d58eac20 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-3076d855-50a4-4ad5-90a9-98a0d58eac20 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:02:45 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-3076d855-50a4-4ad5-90a9-98a0d58eac20 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:02:45 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-3076d855-50a4-4ad5-90a9-98a0d58eac20 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6" status: 200 len: 1784 microversion: 2.20 time: 0.233697 Apr 14 16:02:45 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 290/873] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:02:45 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 => generated 1784 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:02:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:49 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-2a13f69e-619d-46da-95cd-f4ad0d29aed4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:02:49 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-2a13f69e-619d-46da-95cd-f4ad0d29aed4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:02:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2a13f69e-619d-46da-95cd-f4ad0d29aed4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2a13f69e-619d-46da-95cd-f4ad0d29aed4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2a13f69e-619d-46da-95cd-f4ad0d29aed4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2a13f69e-619d-46da-95cd-f4ad0d29aed4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2a13f69e-619d-46da-95cd-f4ad0d29aed4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2a13f69e-619d-46da-95cd-f4ad0d29aed4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:50 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-2a13f69e-619d-46da-95cd-f4ad0d29aed4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:02:50 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-2a13f69e-619d-46da-95cd-f4ad0d29aed4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5" status: 200 len: 1544 microversion: 2.1 time: 0.386612 Apr 14 16:02:50 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 293/874] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:02:49 2023] GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 => generated 1544 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:02:50 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:50 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:50 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:02:50 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-f30c2487-4d1d-468b-a4ca-c4acff28363b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:02:50 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-f30c2487-4d1d-468b-a4ca-c4acff28363b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:02:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f30c2487-4d1d-468b-a4ca-c4acff28363b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f30c2487-4d1d-468b-a4ca-c4acff28363b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f30c2487-4d1d-468b-a4ca-c4acff28363b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f30c2487-4d1d-468b-a4ca-c4acff28363b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f30c2487-4d1d-468b-a4ca-c4acff28363b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-f30c2487-4d1d-468b-a4ca-c4acff28363b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:50 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-f30c2487-4d1d-468b-a4ca-c4acff28363b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "POST /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5/action" status: 200 len: 28333 microversion: 2.1 time: 0.220801 Apr 14 16:02:50 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 292/875] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 16:02:50 2023] POST /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5/action => generated 28333 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 16:02:50 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-96cfd63f-f451-4809-97d5-ddd1ede097b2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:02:50 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-96cfd63f-f451-4809-97d5-ddd1ede097b2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:02:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-96cfd63f-f451-4809-97d5-ddd1ede097b2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-96cfd63f-f451-4809-97d5-ddd1ede097b2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-96cfd63f-f451-4809-97d5-ddd1ede097b2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-96cfd63f-f451-4809-97d5-ddd1ede097b2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:02:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-96cfd63f-f451-4809-97d5-ddd1ede097b2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:02:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-96cfd63f-f451-4809-97d5-ddd1ede097b2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:02:50 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-96cfd63f-f451-4809-97d5-ddd1ede097b2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:02:50 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-96cfd63f-f451-4809-97d5-ddd1ede097b2 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110" status: 200 len: 1538 microversion: 2.1 time: 0.155175 Apr 14 16:02:50 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 291/876] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:02:50 2023] GET /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110 => generated 1538 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:03:15 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-7b880047-35c7-4581-9fc4-e7e4070d7719 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:03:15 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-7b880047-35c7-4581-9fc4-e7e4070d7719 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:03:15 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:03:15 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:03:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7b880047-35c7-4581-9fc4-e7e4070d7719 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7b880047-35c7-4581-9fc4-e7e4070d7719 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7b880047-35c7-4581-9fc4-e7e4070d7719 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7b880047-35c7-4581-9fc4-e7e4070d7719 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7b880047-35c7-4581-9fc4-e7e4070d7719 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:15 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7b880047-35c7-4581-9fc4-e7e4070d7719 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:16 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-7b880047-35c7-4581-9fc4-e7e4070d7719 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:03:16 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-7b880047-35c7-4581-9fc4-e7e4070d7719 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e" status: 200 len: 1544 microversion: 2.1 time: 0.358534 Apr 14 16:03:16 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 294/877] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:03:15 2023] GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e => generated 1544 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:03:45 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:03:45 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:03:45 user devstack@n-api.service[61874]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:03:45 user devstack@n-api.service[61874]: Fri Apr 14 16:03:45 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-volume_attachments/72849de7-745e-4d68-b29a-1c64779bbc48 (ip 10.0.0.210) !!! Apr 14 16:03:45 user devstack@n-api.service[61874]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:03:45 user devstack@n-api.service[61874]: Fri Apr 14 16:03:45 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-volume_attachments/72849de7-745e-4d68-b29a-1c64779bbc48 (ip 10.0.0.210) !!! Apr 14 16:03:46 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-0e77aff7-25e9-4225-9dc9-172406c6262c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:03:46 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-0e77aff7-25e9-4225-9dc9-172406c6262c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:03:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0e77aff7-25e9-4225-9dc9-172406c6262c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0e77aff7-25e9-4225-9dc9-172406c6262c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0e77aff7-25e9-4225-9dc9-172406c6262c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0e77aff7-25e9-4225-9dc9-172406c6262c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0e77aff7-25e9-4225-9dc9-172406c6262c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-0e77aff7-25e9-4225-9dc9-172406c6262c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:46 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-0e77aff7-25e9-4225-9dc9-172406c6262c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-volume_attachments/72849de7-745e-4d68-b29a-1c64779bbc48" status: 200 len: 194 microversion: 2.20 time: 0.190632 Apr 14 16:03:46 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 293/878] 10.0.0.210 () {64 vars in 1531 bytes} [Fri Apr 14 16:03:45 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-volume_attachments/72849de7-745e-4d68-b29a-1c64779bbc48 => generated 194 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:03:46 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:03:46 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:03:46 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:03:46 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=12 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:03:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:46 user devstack@n-api.service[61875]: DEBUG nova.objects.instance [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'services' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=61875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 16:03:46 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-volume_attachments/72849de7-745e-4d68-b29a-1c64779bbc48" status: 202 len: 0 microversion: 2.20 time: 0.247912 Apr 14 16:03:46 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 292/879] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 16:03:46 2023] DELETE /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-volume_attachments/72849de7-745e-4d68-b29a-1c64779bbc48 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:03:46 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-07d620c7-8948-432e-a444-e156ea300e11 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:03:46 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-07d620c7-8948-432e-a444-e156ea300e11 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:03:46 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:03:46 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:03:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-07d620c7-8948-432e-a444-e156ea300e11 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-07d620c7-8948-432e-a444-e156ea300e11 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-07d620c7-8948-432e-a444-e156ea300e11 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-07d620c7-8948-432e-a444-e156ea300e11 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-07d620c7-8948-432e-a444-e156ea300e11 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-07d620c7-8948-432e-a444-e156ea300e11 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:46 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-07d620c7-8948-432e-a444-e156ea300e11 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058419 Apr 14 16:03:46 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 295/880] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 16:03:46 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:03:50 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:03:50 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:03:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:50 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:50 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:03:50 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5" status: 204 len: 0 microversion: 2.1 time: 0.112465 Apr 14 16:03:50 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 294/881] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:03:50 2023] DELETE /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:03:50 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-02132edf-4014-4e84-9da6-980d4e91a88c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:03:50 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-02132edf-4014-4e84-9da6-980d4e91a88c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:03:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-02132edf-4014-4e84-9da6-980d4e91a88c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-02132edf-4014-4e84-9da6-980d4e91a88c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-02132edf-4014-4e84-9da6-980d4e91a88c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-02132edf-4014-4e84-9da6-980d4e91a88c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-02132edf-4014-4e84-9da6-980d4e91a88c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:50 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-02132edf-4014-4e84-9da6-980d4e91a88c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:51 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-02132edf-4014-4e84-9da6-980d4e91a88c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:03:51 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-02132edf-4014-4e84-9da6-980d4e91a88c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5" status: 200 len: 1550 microversion: 2.1 time: 0.346748 Apr 14 16:03:51 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 293/882] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:03:50 2023] GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 => generated 1550 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:03:51 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-428f681a-0ac2-443b-9556-3d456791d5c4 req-97908768-b432-4a98-8412-4c9987d901cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61119681-6ec1-4dee-bf91-908f479488d5", "name": "network-vif-unplugged", "status": "completed", "tag": "bdc45130-027f-49b1-b33a-2a4adbc70f63"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:51 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-428f681a-0ac2-443b-9556-3d456791d5c4 req-97908768-b432-4a98-8412-4c9987d901cd service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:51 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-428f681a-0ac2-443b-9556-3d456791d5c4 req-97908768-b432-4a98-8412-4c9987d901cd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:51 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-428f681a-0ac2-443b-9556-3d456791d5c4 req-97908768-b432-4a98-8412-4c9987d901cd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:51 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-428f681a-0ac2-443b-9556-3d456791d5c4 req-97908768-b432-4a98-8412-4c9987d901cd service nova] Creating event network-vif-unplugged:bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance 61119681-6ec1-4dee-bf91-908f479488d5 on user Apr 14 16:03:51 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-428f681a-0ac2-443b-9556-3d456791d5c4 req-97908768-b432-4a98-8412-4c9987d901cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087336 Apr 14 16:03:51 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 296/883] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:03:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:52 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-182e63c6-a056-457e-92c4-28286b47269b req-9cb6d665-c332-4cd7-9524-6855835837e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61119681-6ec1-4dee-bf91-908f479488d5", "name": "network-vif-deleted", "tag": "bdc45130-027f-49b1-b33a-2a4adbc70f63"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-182e63c6-a056-457e-92c4-28286b47269b req-9cb6d665-c332-4cd7-9524-6855835837e7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-182e63c6-a056-457e-92c4-28286b47269b req-9cb6d665-c332-4cd7-9524-6855835837e7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-182e63c6-a056-457e-92c4-28286b47269b req-9cb6d665-c332-4cd7-9524-6855835837e7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:53 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-182e63c6-a056-457e-92c4-28286b47269b req-9cb6d665-c332-4cd7-9524-6855835837e7 service nova] Creating event network-vif-deleted:bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance 61119681-6ec1-4dee-bf91-908f479488d5 on user Apr 14 16:03:53 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-182e63c6-a056-457e-92c4-28286b47269b req-9cb6d665-c332-4cd7-9524-6855835837e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255542 Apr 14 16:03:53 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 295/884] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:03:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:03:53 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-fc09e9be-16ba-457b-88f2-2484ec66103d req-ae6944a9-1e5a-4f6d-baab-8ad67162b56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61119681-6ec1-4dee-bf91-908f479488d5", "name": "network-vif-plugged", "status": "completed", "tag": "bdc45130-027f-49b1-b33a-2a4adbc70f63"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:03:53 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fc09e9be-16ba-457b-88f2-2484ec66103d req-ae6944a9-1e5a-4f6d-baab-8ad67162b56c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:03:53 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fc09e9be-16ba-457b-88f2-2484ec66103d req-ae6944a9-1e5a-4f6d-baab-8ad67162b56c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:03:53 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fc09e9be-16ba-457b-88f2-2484ec66103d req-ae6944a9-1e5a-4f6d-baab-8ad67162b56c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:03:53 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-fc09e9be-16ba-457b-88f2-2484ec66103d req-ae6944a9-1e5a-4f6d-baab-8ad67162b56c service nova] Creating event network-vif-plugged:bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance 61119681-6ec1-4dee-bf91-908f479488d5 on user Apr 14 16:03:53 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-fc09e9be-16ba-457b-88f2-2484ec66103d req-ae6944a9-1e5a-4f6d-baab-8ad67162b56c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033562 Apr 14 16:03:53 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 294/885] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:03:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:04:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:04:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:04:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-9aaa37c3-eaf7-4bef-80ed-f6ec45950ec0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:04:16 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-9aaa37c3-eaf7-4bef-80ed-f6ec45950ec0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:04:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9aaa37c3-eaf7-4bef-80ed-f6ec45950ec0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9aaa37c3-eaf7-4bef-80ed-f6ec45950ec0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9aaa37c3-eaf7-4bef-80ed-f6ec45950ec0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9aaa37c3-eaf7-4bef-80ed-f6ec45950ec0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9aaa37c3-eaf7-4bef-80ed-f6ec45950ec0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9aaa37c3-eaf7-4bef-80ed-f6ec45950ec0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:16 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-9aaa37c3-eaf7-4bef-80ed-f6ec45950ec0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.171299 Apr 14 16:04:16 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 297/886] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 16:04:16 2023] GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e/os-interface => generated 282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:17 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f624c54-a234-49d3-9e25-a69043cffd3e", "tag": "590df74f-db91-4c1b-afb0-0ffce71bb462"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:17 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:04:17 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-dfef2dd6-0521-4f99-8a56-3b64a7113167 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-dfef2dd6-0521-4f99-8a56-3b64a7113167 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dfef2dd6-0521-4f99-8a56-3b64a7113167 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dfef2dd6-0521-4f99-8a56-3b64a7113167 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dfef2dd6-0521-4f99-8a56-3b64a7113167 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dfef2dd6-0521-4f99-8a56-3b64a7113167 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dfef2dd6-0521-4f99-8a56-3b64a7113167 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-dfef2dd6-0521-4f99-8a56-3b64a7113167 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:17 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-dfef2dd6-0521-4f99-8a56-3b64a7113167 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e/ips" status: 200 len: 108 microversion: 2.1 time: 0.042707 Apr 14 16:04:17 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 295/887] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 16:04:17 2023] GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e/ips => generated 108 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-531b6555-b221-41cb-a4ce-4f905f0dcca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb5d8c5d-23ea-40c7-a2de-43e2f431182f"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-531b6555-b221-41cb-a4ce-4f905f0dcca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-531b6555-b221-41cb-a4ce-4f905f0dcca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-531b6555-b221-41cb-a4ce-4f905f0dcca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-531b6555-b221-41cb-a4ce-4f905f0dcca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-531b6555-b221-41cb-a4ce-4f905f0dcca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-531b6555-b221-41cb-a4ce-4f905f0dcca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-531b6555-b221-41cb-a4ce-4f905f0dcca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:17 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-531b6555-b221-41cb-a4ce-4f905f0dcca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Invalid volume: volume fb5d8c5d-23ea-40c7-a2de-43e2f431182f is already attached to instances: 85ad8a8f-d9e8-4f74-a16f-449616e970ff Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-531b6555-b221-41cb-a4ce-4f905f0dcca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:04:17 user devstack@n-api.service[61876]: request: POST /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e/os-volume_attachments HTTP/1.1 Apr 14 16:04:17 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:04:17 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:04:17 user devstack@n-api.service[61876]: Connection: close Apr 14 16:04:17 user devstack@n-api.service[61876]: Content-Length: 74 Apr 14 16:04:17 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:04:17 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:04:17 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:04:17 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:04:17 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:04:17 user devstack@n-api.service[61876]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:04:17 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:04:17 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:04:17 user devstack@n-api.service[61876]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:04:17 user devstack@n-api.service[61876]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:04:17 user devstack@n-api.service[61876]: Apr 14 16:04:17 user devstack@n-api.service[61876]: {"volumeAttachment": {"volumeId": "fb5d8c5d-23ea-40c7-a2de-43e2f431182f"}} Apr 14 16:04:17 user devstack@n-api.service[61876]: method: > Apr 14 16:04:17 user devstack@n-api.service[61876]: exception: Invalid volume: volume fb5d8c5d-23ea-40c7-a2de-43e2f431182f is already attached to instances: 85ad8a8f-d9e8-4f74-a16f-449616e970ff Apr 14 16:04:17 user devstack@n-api.service[61876]: action_args: {'server_id': '9f624c54-a234-49d3-9e25-a69043cffd3e', 'body': {'volumeAttachment': {'volumeId': 'fb5d8c5d-23ea-40c7-a2de-43e2f431182f'}}} Apr 14 16:04:17 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fb5d8c5d-23ea-40c7-a2de-43e2f431182f is already attached to instances: 85ad8a8f-d9e8-4f74-a16f-449616e970ff Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fb5d8c5d-23ea-40c7-a2de-43e2f431182f is already attached to instances: 85ad8a8f-d9e8-4f74-a16f-449616e970ff Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fb5d8c5d-23ea-40c7-a2de-43e2f431182f is already attached to instances: 85ad8a8f-d9e8-4f74-a16f-449616e970ff Apr 14 16:04:17 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-531b6555-b221-41cb-a4ce-4f905f0dcca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 400 to user: Invalid volume: volume fb5d8c5d-23ea-40c7-a2de-43e2f431182f is already attached to instances: 85ad8a8f-d9e8-4f74-a16f-449616e970ff {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:04:17 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-531b6555-b221-41cb-a4ce-4f905f0dcca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112232 Apr 14 16:04:17 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 298/888] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 16:04:17 2023] POST /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:17 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:04:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:17 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:17 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e" status: 204 len: 0 microversion: 2.1 time: 0.127354 Apr 14 16:04:17 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] Creating event network-changed:590df74f-db91-4c1b-afb0-0ffce71bb462 for instance 9f624c54-a234-49d3-9e25-a69043cffd3e on user Apr 14 16:04:17 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 296/889] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:04:17 2023] DELETE /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:04:17 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344891 Apr 14 16:04:17 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 296/890] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:04:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-14952a79-f54e-402e-a87b-aacaecff44aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-14952a79-f54e-402e-a87b-aacaecff44aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-14952a79-f54e-402e-a87b-aacaecff44aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-14952a79-f54e-402e-a87b-aacaecff44aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-14952a79-f54e-402e-a87b-aacaecff44aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-14952a79-f54e-402e-a87b-aacaecff44aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-14952a79-f54e-402e-a87b-aacaecff44aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-14952a79-f54e-402e-a87b-aacaecff44aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:17 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-14952a79-f54e-402e-a87b-aacaecff44aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:04:17 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-14952a79-f54e-402e-a87b-aacaecff44aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e" status: 200 len: 1550 microversion: 2.1 time: 0.172707 Apr 14 16:04:17 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 299/891] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:04:17 2023] GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:04:18 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-fcf6330a-c0e4-4b4f-97c1-fa3c415c2af3 req-5bb08928-610c-4844-ad13-9fc8dce598ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f624c54-a234-49d3-9e25-a69043cffd3e", "name": "network-vif-unplugged", "status": "completed", "tag": "590df74f-db91-4c1b-afb0-0ffce71bb462"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fcf6330a-c0e4-4b4f-97c1-fa3c415c2af3 req-5bb08928-610c-4844-ad13-9fc8dce598ba service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fcf6330a-c0e4-4b4f-97c1-fa3c415c2af3 req-5bb08928-610c-4844-ad13-9fc8dce598ba service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:18 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fcf6330a-c0e4-4b4f-97c1-fa3c415c2af3 req-5bb08928-610c-4844-ad13-9fc8dce598ba service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:18 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-fcf6330a-c0e4-4b4f-97c1-fa3c415c2af3 req-5bb08928-610c-4844-ad13-9fc8dce598ba service nova] Creating event network-vif-unplugged:590df74f-db91-4c1b-afb0-0ffce71bb462 for instance 9f624c54-a234-49d3-9e25-a69043cffd3e on user Apr 14 16:04:18 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-fcf6330a-c0e4-4b4f-97c1-fa3c415c2af3 req-5bb08928-610c-4844-ad13-9fc8dce598ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030058 Apr 14 16:04:18 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 297/892] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:04:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:20 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f624c54-a234-49d3-9e25-a69043cffd3e", "name": "network-vif-plugged", "status": "completed", "tag": "590df74f-db91-4c1b-afb0-0ffce71bb462"}, {"server_uuid": "9f624c54-a234-49d3-9e25-a69043cffd3e", "name": "network-vif-deleted", "tag": "590df74f-db91-4c1b-afb0-0ffce71bb462"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] Creating event network-vif-plugged:590df74f-db91-4c1b-afb0-0ffce71bb462 for instance 9f624c54-a234-49d3-9e25-a69043cffd3e on user Apr 14 16:04:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] Creating event network-vif-deleted:590df74f-db91-4c1b-afb0-0ffce71bb462 for instance 9f624c54-a234-49d3-9e25-a69043cffd3e on user Apr 14 16:04:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028670 Apr 14 16:04:20 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 297/893] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:04:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:36 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-e80994bb-7431-4091-892a-2797b02eadc5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:04:36 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-e80994bb-7431-4091-892a-2797b02eadc5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:04:36 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:04:36 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=16 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:04:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e80994bb-7431-4091-892a-2797b02eadc5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e80994bb-7431-4091-892a-2797b02eadc5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e80994bb-7431-4091-892a-2797b02eadc5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e80994bb-7431-4091-892a-2797b02eadc5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e80994bb-7431-4091-892a-2797b02eadc5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:36 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e80994bb-7431-4091-892a-2797b02eadc5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:36 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-e80994bb-7431-4091-892a-2797b02eadc5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059769 Apr 14 16:04:36 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 300/894] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 16:04:36 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:04:36 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:04:36 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:04:36 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:04:36 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:04:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:36 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:04:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6" status: 204 len: 0 microversion: 2.20 time: 0.130609 Apr 14 16:04:36 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 298/895] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 16:04:36 2023] DELETE /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 16:04:36 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:04:36 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:04:36 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-daeb792d-8422-4075-9d1d-b2f0b4b51e46 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:04:36 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-daeb792d-8422-4075-9d1d-b2f0b4b51e46 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:04:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daeb792d-8422-4075-9d1d-b2f0b4b51e46 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daeb792d-8422-4075-9d1d-b2f0b4b51e46 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daeb792d-8422-4075-9d1d-b2f0b4b51e46 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daeb792d-8422-4075-9d1d-b2f0b4b51e46 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daeb792d-8422-4075-9d1d-b2f0b4b51e46 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-daeb792d-8422-4075-9d1d-b2f0b4b51e46 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:37 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-a061a4f2-1061-40bc-bf35-d26d38bbf083 req-01704b10-c6e6-4a2c-8414-cc0a96c1198b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebde9c7-b620-4553-856c-c6a3429381b6", "name": "network-vif-unplugged", "status": "completed", "tag": "e7e2966b-fc86-47d5-a656-93ba5e362a42"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a061a4f2-1061-40bc-bf35-d26d38bbf083 req-01704b10-c6e6-4a2c-8414-cc0a96c1198b service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a061a4f2-1061-40bc-bf35-d26d38bbf083 req-01704b10-c6e6-4a2c-8414-cc0a96c1198b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-a061a4f2-1061-40bc-bf35-d26d38bbf083 req-01704b10-c6e6-4a2c-8414-cc0a96c1198b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:37 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-a061a4f2-1061-40bc-bf35-d26d38bbf083 req-01704b10-c6e6-4a2c-8414-cc0a96c1198b service nova] Creating event network-vif-unplugged:e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 on user Apr 14 16:04:37 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-a061a4f2-1061-40bc-bf35-d26d38bbf083 req-01704b10-c6e6-4a2c-8414-cc0a96c1198b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044019 Apr 14 16:04:37 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 301/896] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:04:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:37 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-daeb792d-8422-4075-9d1d-b2f0b4b51e46 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:04:37 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-daeb792d-8422-4075-9d1d-b2f0b4b51e46 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:04:37 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-daeb792d-8422-4075-9d1d-b2f0b4b51e46 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:04:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-daeb792d-8422-4075-9d1d-b2f0b4b51e46 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6" status: 200 len: 1712 microversion: 2.20 time: 0.380072 Apr 14 16:04:37 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 298/897] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:04:36 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 => generated 1712 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 16:04:38 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-664b7670-3ba6-4fb1-be42-570cb2dc3523 req-eb168279-2f02-42a6-ada7-276e7666c181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebde9c7-b620-4553-856c-c6a3429381b6", "name": "network-vif-deleted", "tag": "e7e2966b-fc86-47d5-a656-93ba5e362a42"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-664b7670-3ba6-4fb1-be42-570cb2dc3523 req-eb168279-2f02-42a6-ada7-276e7666c181 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-664b7670-3ba6-4fb1-be42-570cb2dc3523 req-eb168279-2f02-42a6-ada7-276e7666c181 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-664b7670-3ba6-4fb1-be42-570cb2dc3523 req-eb168279-2f02-42a6-ada7-276e7666c181 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-664b7670-3ba6-4fb1-be42-570cb2dc3523 req-eb168279-2f02-42a6-ada7-276e7666c181 service nova] Creating event network-vif-deleted:e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 on user Apr 14 16:04:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-664b7670-3ba6-4fb1-be42-570cb2dc3523 req-eb168279-2f02-42a6-ada7-276e7666c181 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031240 Apr 14 16:04:38 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 299/898] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:04:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:39 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-35803b3f-2f4b-467e-b5dc-c7ed2de28e76 req-ef0d03cb-2b9f-4541-b730-510c75fe7b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebde9c7-b620-4553-856c-c6a3429381b6", "name": "network-vif-plugged", "status": "completed", "tag": "e7e2966b-fc86-47d5-a656-93ba5e362a42"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-35803b3f-2f4b-467e-b5dc-c7ed2de28e76 req-ef0d03cb-2b9f-4541-b730-510c75fe7b88 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-35803b3f-2f4b-467e-b5dc-c7ed2de28e76 req-ef0d03cb-2b9f-4541-b730-510c75fe7b88 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-35803b3f-2f4b-467e-b5dc-c7ed2de28e76 req-ef0d03cb-2b9f-4541-b730-510c75fe7b88 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:39 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-35803b3f-2f4b-467e-b5dc-c7ed2de28e76 req-ef0d03cb-2b9f-4541-b730-510c75fe7b88 service nova] Creating event network-vif-plugged:e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 on user Apr 14 16:04:39 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-35803b3f-2f4b-467e-b5dc-c7ed2de28e76 req-ef0d03cb-2b9f-4541-b730-510c75fe7b88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031758 Apr 14 16:04:39 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 302/899] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:04:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-dbc9f971-8a07-4554-803e-5e2a6f18e6bb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-dbc9f971-8a07-4554-803e-5e2a6f18e6bb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-dbc9f971-8a07-4554-803e-5e2a6f18e6bb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-dbc9f971-8a07-4554-803e-5e2a6f18e6bb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-dbc9f971-8a07-4554-803e-5e2a6f18e6bb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-dbc9f971-8a07-4554-803e-5e2a6f18e6bb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-dbc9f971-8a07-4554-803e-5e2a6f18e6bb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-dbc9f971-8a07-4554-803e-5e2a6f18e6bb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-dbc9f971-8a07-4554-803e-5e2a6f18e6bb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HTTP exception thrown: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-dbc9f971-8a07-4554-803e-5e2a6f18e6bb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Request method failure captured: Apr 14 16:04:41 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 HTTP/1.1 Apr 14 16:04:41 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:04:41 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:04:41 user devstack@n-api.service[61874]: Connection: close Apr 14 16:04:41 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:04:41 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:04:41 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:04:41 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:04:41 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXQCThpy3yl6l1TCWVl5qU9ObX9ml7vxjJ1brRtAPkbr5ZkdoJQff6z6UDjK5Q28yasEVG9HXQzHH37jgV5YNAsEJoMKFqOHBJp644GvPOnwDCBB71n3Hhn9EBLtM10HjdAX1t1mFB8pYmFsnraSY0KDD3eoZp0nTUBMTr6jHRO65Nw Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Project-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Project-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/95e26fa4727e46479d108fe49e225706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Tenant: tempest-ServerActionsTestJSON-649148824 Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Tenant-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 16:04:41 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 16:04:41 user devstack@n-api.service[61874]: X-User: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 16:04:41 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:04:41 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:04:41 user devstack@n-api.service[61874]: X-User-Id: 3062186c340a4cfe875d5455b0ace246 Apr 14 16:04:41 user devstack@n-api.service[61874]: X-User-Name: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 16:04:41 user devstack@n-api.service[61874]: method: > Apr 14 16:04:41 user devstack@n-api.service[61874]: exception: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61874]: action_args: {'id': '61119681-6ec1-4dee-bf91-908f479488d5'} Apr 14 16:04:41 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-dbc9f971-8a07-4554-803e-5e2a6f18e6bb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Returning 404 to user: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:04:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-dbc9f971-8a07-4554-803e-5e2a6f18e6bb tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5" status: 404 len: 111 microversion: 2.1 time: 0.027595 Apr 14 16:04:41 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 299/900] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:04:41 2023] GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3cfe1e7d-b633-49cb-9b26-d5cf3c457515 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-3cfe1e7d-b633-49cb-9b26-d5cf3c457515 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3cfe1e7d-b633-49cb-9b26-d5cf3c457515 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3cfe1e7d-b633-49cb-9b26-d5cf3c457515 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3cfe1e7d-b633-49cb-9b26-d5cf3c457515 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3cfe1e7d-b633-49cb-9b26-d5cf3c457515 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3cfe1e7d-b633-49cb-9b26-d5cf3c457515 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3cfe1e7d-b633-49cb-9b26-d5cf3c457515 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:41 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-3cfe1e7d-b633-49cb-9b26-d5cf3c457515 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HTTP exception thrown: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3cfe1e7d-b633-49cb-9b26-d5cf3c457515 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Request method failure captured: Apr 14 16:04:41 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 HTTP/1.1 Apr 14 16:04:41 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:04:41 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:04:41 user devstack@n-api.service[61875]: Connection: close Apr 14 16:04:41 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:04:41 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:04:41 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:04:41 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:04:41 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXQCThpy3yl6l1TCWVl5qU9ObX9ml7vxjJ1brRtAPkbr5ZkdoJQff6z6UDjK5Q28yasEVG9HXQzHH37jgV5YNAsEJoMKFqOHBJp644GvPOnwDCBB71n3Hhn9EBLtM10HjdAX1t1mFB8pYmFsnraSY0KDD3eoZp0nTUBMTr6jHRO65Nw Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Project-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Project-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/95e26fa4727e46479d108fe49e225706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Tenant: tempest-ServerActionsTestJSON-649148824 Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Tenant-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 16:04:41 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 16:04:41 user devstack@n-api.service[61875]: X-User: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 16:04:41 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:04:41 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:04:41 user devstack@n-api.service[61875]: X-User-Id: 3062186c340a4cfe875d5455b0ace246 Apr 14 16:04:41 user devstack@n-api.service[61875]: X-User-Name: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 16:04:41 user devstack@n-api.service[61875]: method: > Apr 14 16:04:41 user devstack@n-api.service[61875]: exception: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61875]: action_args: {'id': '61119681-6ec1-4dee-bf91-908f479488d5'} Apr 14 16:04:41 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3cfe1e7d-b633-49cb-9b26-d5cf3c457515 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Returning 404 to user: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:04:41 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-3cfe1e7d-b633-49cb-9b26-d5cf3c457515 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5" status: 404 len: 111 microversion: 2.1 time: 0.032650 Apr 14 16:04:41 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 300/901] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:04:41 2023] DELETE /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-26495bb9-adb4-444c-8675-355aed77364d tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-26495bb9-adb4-444c-8675-355aed77364d tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-26495bb9-adb4-444c-8675-355aed77364d tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-26495bb9-adb4-444c-8675-355aed77364d tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-26495bb9-adb4-444c-8675-355aed77364d tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-26495bb9-adb4-444c-8675-355aed77364d tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-26495bb9-adb4-444c-8675-355aed77364d tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-26495bb9-adb4-444c-8675-355aed77364d tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-26495bb9-adb4-444c-8675-355aed77364d tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HTTP exception thrown: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-26495bb9-adb4-444c-8675-355aed77364d tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Request method failure captured: Apr 14 16:04:41 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 HTTP/1.1 Apr 14 16:04:41 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:04:41 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:04:41 user devstack@n-api.service[61876]: Connection: close Apr 14 16:04:41 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:04:41 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:04:41 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:04:41 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:04:41 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXQCThpy3yl6l1TCWVl5qU9ObX9ml7vxjJ1brRtAPkbr5ZkdoJQff6z6UDjK5Q28yasEVG9HXQzHH37jgV5YNAsEJoMKFqOHBJp644GvPOnwDCBB71n3Hhn9EBLtM10HjdAX1t1mFB8pYmFsnraSY0KDD3eoZp0nTUBMTr6jHRO65Nw Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Project-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Project-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/95e26fa4727e46479d108fe49e225706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Tenant: tempest-ServerActionsTestJSON-649148824 Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Tenant-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 16:04:41 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 16:04:41 user devstack@n-api.service[61876]: X-User: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 16:04:41 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:04:41 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:04:41 user devstack@n-api.service[61876]: X-User-Id: 3062186c340a4cfe875d5455b0ace246 Apr 14 16:04:41 user devstack@n-api.service[61876]: X-User-Name: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 16:04:41 user devstack@n-api.service[61876]: method: > Apr 14 16:04:41 user devstack@n-api.service[61876]: exception: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61876]: action_args: {'id': '61119681-6ec1-4dee-bf91-908f479488d5'} Apr 14 16:04:41 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. Apr 14 16:04:41 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-26495bb9-adb4-444c-8675-355aed77364d tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Returning 404 to user: Instance 61119681-6ec1-4dee-bf91-908f479488d5 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:04:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-26495bb9-adb4-444c-8675-355aed77364d tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5" status: 404 len: 111 microversion: 2.1 time: 0.030456 Apr 14 16:04:41 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 303/902] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:04:41 2023] GET /compute/v2.1/servers/61119681-6ec1-4dee-bf91-908f479488d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:41 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:04:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110" status: 204 len: 0 microversion: 2.1 time: 0.150876 Apr 14 16:04:41 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 300/903] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:04:41 2023] DELETE /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-e4a599ed-6567-4826-b4b2-0eab37bf4fba tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-e4a599ed-6567-4826-b4b2-0eab37bf4fba tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e4a599ed-6567-4826-b4b2-0eab37bf4fba tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e4a599ed-6567-4826-b4b2-0eab37bf4fba tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e4a599ed-6567-4826-b4b2-0eab37bf4fba tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e4a599ed-6567-4826-b4b2-0eab37bf4fba tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e4a599ed-6567-4826-b4b2-0eab37bf4fba tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e4a599ed-6567-4826-b4b2-0eab37bf4fba tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-08b6704b-0bb0-4974-beeb-318fe439f9c4 req-d7de3602-7448-4b10-9848-fe645fb23a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0fcb3f5-6676-43a8-b6e2-2da51d195110", "name": "network-vif-unplugged", "status": "completed", "tag": "e3e86dec-e3bf-4584-8918-eb5d22e8428a"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-08b6704b-0bb0-4974-beeb-318fe439f9c4 req-d7de3602-7448-4b10-9848-fe645fb23a0f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-08b6704b-0bb0-4974-beeb-318fe439f9c4 req-d7de3602-7448-4b10-9848-fe645fb23a0f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:41 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-08b6704b-0bb0-4974-beeb-318fe439f9c4 req-d7de3602-7448-4b10-9848-fe645fb23a0f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:41 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-e4a599ed-6567-4826-b4b2-0eab37bf4fba tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:04:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-08b6704b-0bb0-4974-beeb-318fe439f9c4 req-d7de3602-7448-4b10-9848-fe645fb23a0f service nova] Creating event network-vif-unplugged:e3e86dec-e3bf-4584-8918-eb5d22e8428a for instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 on user Apr 14 16:04:41 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-e4a599ed-6567-4826-b4b2-0eab37bf4fba tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110" status: 200 len: 1544 microversion: 2.1 time: 0.386152 Apr 14 16:04:41 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 301/904] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:04:41 2023] GET /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110 => generated 1544 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:04:41 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-08b6704b-0bb0-4974-beeb-318fe439f9c4 req-d7de3602-7448-4b10-9848-fe645fb23a0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036447 Apr 14 16:04:41 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 304/905] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:04:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:42 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-1c5074f7-3713-4f93-bd96-4a68f5207d29 req-57e4fffb-d2cf-46fa-864d-616fa2497bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0fcb3f5-6676-43a8-b6e2-2da51d195110", "name": "network-vif-deleted", "tag": "e3e86dec-e3bf-4584-8918-eb5d22e8428a"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1c5074f7-3713-4f93-bd96-4a68f5207d29 req-57e4fffb-d2cf-46fa-864d-616fa2497bd5 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1c5074f7-3713-4f93-bd96-4a68f5207d29 req-57e4fffb-d2cf-46fa-864d-616fa2497bd5 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1c5074f7-3713-4f93-bd96-4a68f5207d29 req-57e4fffb-d2cf-46fa-864d-616fa2497bd5 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:42 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-1c5074f7-3713-4f93-bd96-4a68f5207d29 req-57e4fffb-d2cf-46fa-864d-616fa2497bd5 service nova] Creating event network-vif-deleted:e3e86dec-e3bf-4584-8918-eb5d22e8428a for instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 on user Apr 14 16:04:42 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-1c5074f7-3713-4f93-bd96-4a68f5207d29 req-57e4fffb-d2cf-46fa-864d-616fa2497bd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032950 Apr 14 16:04:42 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 301/906] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:04:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:04:43 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-ae594e61-b1d5-4599-9e54-bfd310046f7d req-34cdf80d-e631-4e4e-b3fe-158f765d7af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0fcb3f5-6676-43a8-b6e2-2da51d195110", "name": "network-vif-plugged", "status": "completed", "tag": "e3e86dec-e3bf-4584-8918-eb5d22e8428a"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:04:43 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ae594e61-b1d5-4599-9e54-bfd310046f7d req-34cdf80d-e631-4e4e-b3fe-158f765d7af9 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:04:43 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ae594e61-b1d5-4599-9e54-bfd310046f7d req-34cdf80d-e631-4e4e-b3fe-158f765d7af9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:04:43 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ae594e61-b1d5-4599-9e54-bfd310046f7d req-34cdf80d-e631-4e4e-b3fe-158f765d7af9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:04:43 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-ae594e61-b1d5-4599-9e54-bfd310046f7d req-34cdf80d-e631-4e4e-b3fe-158f765d7af9 service nova] Creating event network-vif-plugged:e3e86dec-e3bf-4584-8918-eb5d22e8428a for instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 on user Apr 14 16:04:43 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-ae594e61-b1d5-4599-9e54-bfd310046f7d req-34cdf80d-e631-4e4e-b3fe-158f765d7af9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028954 Apr 14 16:04:43 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 302/907] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:04:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:05:07 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=10 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:07 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=14 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:07 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-64ec5b97-ca42-4f16-b684-f81de4e711ea tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:07 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-64ec5b97-ca42-4f16-b684-f81de4e711ea tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:05:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-64ec5b97-ca42-4f16-b684-f81de4e711ea tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-64ec5b97-ca42-4f16-b684-f81de4e711ea tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-64ec5b97-ca42-4f16-b684-f81de4e711ea tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-64ec5b97-ca42-4f16-b684-f81de4e711ea tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-64ec5b97-ca42-4f16-b684-f81de4e711ea tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-64ec5b97-ca42-4f16-b684-f81de4e711ea tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:07 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-64ec5b97-ca42-4f16-b684-f81de4e711ea tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:05:07 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-64ec5b97-ca42-4f16-b684-f81de4e711ea tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:05:07 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e HTTP/1.1 Apr 14 16:05:07 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:05:07 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:05:07 user devstack@n-api.service[61876]: Connection: close Apr 14 16:05:07 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:05:07 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:05:07 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:05:07 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:05:07 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:05:07 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:05:07 user devstack@n-api.service[61876]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:05:07 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:05:07 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:05:07 user devstack@n-api.service[61876]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:05:07 user devstack@n-api.service[61876]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:05:07 user devstack@n-api.service[61876]: method: > Apr 14 16:05:07 user devstack@n-api.service[61876]: exception: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:05:07 user devstack@n-api.service[61876]: action_args: {'id': '9f624c54-a234-49d3-9e25-a69043cffd3e'} Apr 14 16:05:07 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:05:07 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:05:07 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-64ec5b97-ca42-4f16-b684-f81de4e711ea tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 404 to user: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:05:07 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-64ec5b97-ca42-4f16-b684-f81de4e711ea tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e" status: 404 len: 111 microversion: 2.1 time: 0.034726 Apr 14 16:05:07 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 305/908] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:05:07 2023] GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:05:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-09dde552-b7e4-4d95-b6f2-095ce4e0f1f5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '.version_select at 0x7f297075fc70>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-09dde552-b7e4-4d95-b6f2-095ce4e0f1f5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-793451587" status: 202 len: 0 microversion: 2.1 time: 0.038156 Apr 14 16:05:07 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 302/909] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 16:05:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-793451587 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:05:08 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:08 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:08 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:08 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:05:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:08 user devstack@n-api.service[61875]: DEBUG nova.objects.instance [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'services' on Instance uuid 85ad8a8f-d9e8-4f74-a16f-449616e970ff {{(pid=61875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 16:05:08 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff/os-volume_attachments/fb5d8c5d-23ea-40c7-a2de-43e2f431182f" status: 202 len: 0 microversion: 2.1 time: 0.164125 Apr 14 16:05:08 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 303/910] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 16:05:08 2023] DELETE /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff/os-volume_attachments/fb5d8c5d-23ea-40c7-a2de-43e2f431182f => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:05:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-c460dd4f-729c-4904-b57b-6c8f7e2eeaf4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:08 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-c460dd4f-729c-4904-b57b-6c8f7e2eeaf4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:05:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c460dd4f-729c-4904-b57b-6c8f7e2eeaf4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c460dd4f-729c-4904-b57b-6c8f7e2eeaf4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c460dd4f-729c-4904-b57b-6c8f7e2eeaf4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c460dd4f-729c-4904-b57b-6c8f7e2eeaf4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c460dd4f-729c-4904-b57b-6c8f7e2eeaf4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c460dd4f-729c-4904-b57b-6c8f7e2eeaf4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-c460dd4f-729c-4904-b57b-6c8f7e2eeaf4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Apr 14 16:05:08 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 306/911] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 16:05:08 2023] GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:05:27 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:27 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-89fc476e-4007-48ff-93bc-26a7990fb14c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:27 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-89fc476e-4007-48ff-93bc-26a7990fb14c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:05:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-89fc476e-4007-48ff-93bc-26a7990fb14c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-89fc476e-4007-48ff-93bc-26a7990fb14c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-89fc476e-4007-48ff-93bc-26a7990fb14c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-89fc476e-4007-48ff-93bc-26a7990fb14c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-89fc476e-4007-48ff-93bc-26a7990fb14c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:27 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-89fc476e-4007-48ff-93bc-26a7990fb14c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:27 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-89fc476e-4007-48ff-93bc-26a7990fb14c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] HTTP exception thrown: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:05:27 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-89fc476e-4007-48ff-93bc-26a7990fb14c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Request method failure captured: Apr 14 16:05:27 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 HTTP/1.1 Apr 14 16:05:27 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:05:27 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:05:27 user devstack@n-api.service[61874]: Connection: close Apr 14 16:05:27 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:05:27 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:05:27 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:05:27 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:05:27 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXgNEVA_utxKv7mi1WYJGZur2b31jANkV6VuQB4jdLQmaIQWOAofjq3jeuIFO1xh7pkyLY7hTEqZAVH26QUOyMPoPmNOGIaq0WB2Ka2i2jxM7cTslU6i_GEzXZzsrTJ-bekg5SFWnJQOvJ0Xo_A8y4TLs4dXbwmA2yzxJU0eQs4ZFa8 Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Project-Id: b0dd8e5513a94cc8b22c291bac3b066f Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Tenant-Id: b0dd8e5513a94cc8b22c291bac3b066f Apr 14 16:05:27 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:05:27 user devstack@n-api.service[61874]: X-User: tempest-AttachVolumeShelveTestJSON-1653640190-project-member Apr 14 16:05:27 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:05:27 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:05:27 user devstack@n-api.service[61874]: X-User-Id: 194adad706f94ef89a86fbcb9d8888ac Apr 14 16:05:27 user devstack@n-api.service[61874]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1653640190-project-member Apr 14 16:05:27 user devstack@n-api.service[61874]: method: > Apr 14 16:05:27 user devstack@n-api.service[61874]: exception: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:05:27 user devstack@n-api.service[61874]: action_args: {'id': '8ebde9c7-b620-4553-856c-c6a3429381b6'} Apr 14 16:05:27 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:05:27 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:05:27 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-89fc476e-4007-48ff-93bc-26a7990fb14c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Returning 404 to user: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:05:27 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-89fc476e-4007-48ff-93bc-26a7990fb14c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6" status: 404 len: 111 microversion: 2.20 time: 0.031723 Apr 14 16:05:27 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 303/912] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:05:27 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:05:27 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:27 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:27 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-e9f7ff16-cd44-4727-bd9b-2076b34ba118 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '.version_select at 0x7f297087e320>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:27 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-e9f7ff16-cd44-4727-bd9b-2076b34ba118 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-506635828" status: 204 len: 0 microversion: 2.20 time: 0.030983 Apr 14 16:05:27 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 304/913] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 16:05:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-506635828 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 16:05:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ad98b797-33ba-43e8-b653-fd71d17c2f6f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Action: 'create', calling method: .version_select at 0x7f2970865ea0>, body: {"keypair": {"name": "tempest-keypair-564331105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNipUVm/SMGITJ/VqIfLO974eqF4qj5uNHbX8svN0zvFZEcFu4uU1z2c8JUk1b8hdRDZntipAlsBEvp03UjR31lBoZlbhXKRg4gjqurx76SHqLWPJwkwrDAXvR7xo0zLAQ=="}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:05:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:28 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-ad98b797-33ba-43e8-b653-fd71d17c2f6f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Getting quotas for project b0dd8e5513a94cc8b22c291bac3b066f. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:05:28 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-ad98b797-33ba-43e8-b653-fd71d17c2f6f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Getting quotas for user 194adad706f94ef89a86fbcb9d8888ac and project b0dd8e5513a94cc8b22c291bac3b066f. Resources: {'key_pairs'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:05:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ad98b797-33ba-43e8-b653-fd71d17c2f6f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050041 Apr 14 16:05:28 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 307/914] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 16:05:28 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 16:05:29 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-124723558", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "02907ca9-ef91-415d-916b-dcf4c9134b49"}], "security_groups": [{"name": "tempest-securitygroup--1870491900"}], "key_name": "tempest-keypair-564331105", "user_data": "}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:05:29 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] validate_networks() for [('02907ca9-ef91-415d-916b-dcf4c9134b49', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Getting quotas for project b0dd8e5513a94cc8b22c291bac3b066f. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Getting quotas for user 194adad706f94ef89a86fbcb9d8888ac and project b0dd8e5513a94cc8b22c291bac3b066f. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:05:30 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:05:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.654259 Apr 14 16:05:30 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 304/915] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 16:05:29 2023] POST /compute/v2.1/servers => generated 400 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 16:05:30 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-bbaeaeb6-15a8-40e6-8c77-9fe3b7bb0231 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:30 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-bbaeaeb6-15a8-40e6-8c77-9fe3b7bb0231 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:05:30 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-bbaeaeb6-15a8-40e6-8c77-9fe3b7bb0231 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:05:30 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-bbaeaeb6-15a8-40e6-8c77-9fe3b7bb0231 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:05:30 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-bbaeaeb6-15a8-40e6-8c77-9fe3b7bb0231 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:05:30 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-bbaeaeb6-15a8-40e6-8c77-9fe3b7bb0231 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38" status: 200 len: 1274 microversion: 2.20 time: 0.068927 Apr 14 16:05:30 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 305/916] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:05:30 2023] GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 => generated 1274 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:05:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-fad4b76a-e8f7-4c83-9bf8-2dbe3d8e3be7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:31 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-fad4b76a-e8f7-4c83-9bf8-2dbe3d8e3be7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:05:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fad4b76a-e8f7-4c83-9bf8-2dbe3d8e3be7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fad4b76a-e8f7-4c83-9bf8-2dbe3d8e3be7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fad4b76a-e8f7-4c83-9bf8-2dbe3d8e3be7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fad4b76a-e8f7-4c83-9bf8-2dbe3d8e3be7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fad4b76a-e8f7-4c83-9bf8-2dbe3d8e3be7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fad4b76a-e8f7-4c83-9bf8-2dbe3d8e3be7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-fad4b76a-e8f7-4c83-9bf8-2dbe3d8e3be7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HTTP exception thrown: Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 could not be found. Apr 14 16:05:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-fad4b76a-e8f7-4c83-9bf8-2dbe3d8e3be7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Request method failure captured: Apr 14 16:05:31 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110 HTTP/1.1 Apr 14 16:05:31 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:05:31 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:05:31 user devstack@n-api.service[61876]: Connection: close Apr 14 16:05:31 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:05:31 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:05:31 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:05:31 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:05:31 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXQCThpy3yl6l1TCWVl5qU9ObX9ml7vxjJ1brRtAPkbr5ZkdoJQff6z6UDjK5Q28yasEVG9HXQzHH37jgV5YNAsEJoMKFqOHBJp644GvPOnwDCBB71n3Hhn9EBLtM10HjdAX1t1mFB8pYmFsnraSY0KDD3eoZp0nTUBMTr6jHRO65Nw Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Project-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Project-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/95e26fa4727e46479d108fe49e225706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Tenant: tempest-ServerActionsTestJSON-649148824 Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Tenant-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 16:05:31 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 16:05:31 user devstack@n-api.service[61876]: X-User: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 16:05:31 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:05:31 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:05:31 user devstack@n-api.service[61876]: X-User-Id: 3062186c340a4cfe875d5455b0ace246 Apr 14 16:05:31 user devstack@n-api.service[61876]: X-User-Name: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 16:05:31 user devstack@n-api.service[61876]: method: > Apr 14 16:05:31 user devstack@n-api.service[61876]: exception: Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 could not be found. Apr 14 16:05:31 user devstack@n-api.service[61876]: action_args: {'id': 'e0fcb3f5-6676-43a8-b6e2-2da51d195110'} Apr 14 16:05:31 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 could not be found. Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 could not be found. Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 could not be found. Apr 14 16:05:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:05:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-fad4b76a-e8f7-4c83-9bf8-2dbe3d8e3be7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Returning 404 to user: Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:05:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-fad4b76a-e8f7-4c83-9bf8-2dbe3d8e3be7 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110" status: 404 len: 111 microversion: 2.1 time: 0.029807 Apr 14 16:05:31 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 308/917] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:05:31 2023] GET /compute/v2.1/servers/e0fcb3f5-6676-43a8-b6e2-2da51d195110 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:05:33 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89cb156f-a586-4206-b995-999ebca99f38", "tag": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:05:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:33 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] Creating event network-changed:4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance 89cb156f-a586-4206-b995-999ebca99f38 on user Apr 14 16:05:33 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029990 Apr 14 16:05:33 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 305/918] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:05:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:05:36 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-6b98ed63-08c6-4019-a2b4-5d2d4fb65b06 req-053e495a-00fe-4a50-a9de-f7c56d323f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cb156f-a586-4206-b995-999ebca99f38", "name": "network-vif-plugged", "status": "completed", "tag": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:05:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6b98ed63-08c6-4019-a2b4-5d2d4fb65b06 req-053e495a-00fe-4a50-a9de-f7c56d323f07 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6b98ed63-08c6-4019-a2b4-5d2d4fb65b06 req-053e495a-00fe-4a50-a9de-f7c56d323f07 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-6b98ed63-08c6-4019-a2b4-5d2d4fb65b06 req-053e495a-00fe-4a50-a9de-f7c56d323f07 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-6b98ed63-08c6-4019-a2b4-5d2d4fb65b06 req-053e495a-00fe-4a50-a9de-f7c56d323f07 service nova] Creating event network-vif-plugged:4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance 89cb156f-a586-4206-b995-999ebca99f38 on user Apr 14 16:05:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-6b98ed63-08c6-4019-a2b4-5d2d4fb65b06 req-053e495a-00fe-4a50-a9de-f7c56d323f07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054740 Apr 14 16:05:36 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 306/919] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:05:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:05:38 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:38 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-9b80a8b5-db6e-4a1d-abab-70edd9008210 req-ad77e941-af2a-496a-8a28-39c81edfd014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cb156f-a586-4206-b995-999ebca99f38", "name": "network-vif-plugged", "status": "completed", "tag": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:05:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9b80a8b5-db6e-4a1d-abab-70edd9008210 req-ad77e941-af2a-496a-8a28-39c81edfd014 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9b80a8b5-db6e-4a1d-abab-70edd9008210 req-ad77e941-af2a-496a-8a28-39c81edfd014 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9b80a8b5-db6e-4a1d-abab-70edd9008210 req-ad77e941-af2a-496a-8a28-39c81edfd014 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:38 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-9b80a8b5-db6e-4a1d-abab-70edd9008210 req-ad77e941-af2a-496a-8a28-39c81edfd014 service nova] Creating event network-vif-plugged:4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance 89cb156f-a586-4206-b995-999ebca99f38 on user Apr 14 16:05:38 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-9b80a8b5-db6e-4a1d-abab-70edd9008210 req-ad77e941-af2a-496a-8a28-39c81edfd014 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031889 Apr 14 16:05:38 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 309/920] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:05:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:05:38 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-7db39673-3988-48ae-98bd-7f71f47ea799 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:38 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-7db39673-3988-48ae-98bd-7f71f47ea799 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:05:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7db39673-3988-48ae-98bd-7f71f47ea799 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7db39673-3988-48ae-98bd-7f71f47ea799 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7db39673-3988-48ae-98bd-7f71f47ea799 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7db39673-3988-48ae-98bd-7f71f47ea799 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7db39673-3988-48ae-98bd-7f71f47ea799 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7db39673-3988-48ae-98bd-7f71f47ea799 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:38 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-7db39673-3988-48ae-98bd-7f71f47ea799 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HTTP exception thrown: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 16:05:38 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-7db39673-3988-48ae-98bd-7f71f47ea799 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Request method failure captured: Apr 14 16:05:38 user devstack@n-api.service[61874]: request: DELETE /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 HTTP/1.1 Apr 14 16:05:38 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:05:38 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:05:38 user devstack@n-api.service[61874]: Connection: close Apr 14 16:05:38 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:05:38 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:05:38 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:05:38 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:05:38 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXQCThpy3yl6l1TCWVl5qU9ObX9ml7vxjJ1brRtAPkbr5ZkdoJQff6z6UDjK5Q28yasEVG9HXQzHH37jgV5YNAsEJoMKFqOHBJp644GvPOnwDCBB71n3Hhn9EBLtM10HjdAX1t1mFB8pYmFsnraSY0KDD3eoZp0nTUBMTr6jHRO65Nw Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Project-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Project-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/95e26fa4727e46479d108fe49e225706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Tenant: tempest-ServerActionsTestJSON-649148824 Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Tenant-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 16:05:38 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 16:05:38 user devstack@n-api.service[61874]: X-User: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 16:05:38 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:05:38 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:05:38 user devstack@n-api.service[61874]: X-User-Id: 3062186c340a4cfe875d5455b0ace246 Apr 14 16:05:38 user devstack@n-api.service[61874]: X-User-Name: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 16:05:38 user devstack@n-api.service[61874]: method: > Apr 14 16:05:38 user devstack@n-api.service[61874]: exception: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 16:05:38 user devstack@n-api.service[61874]: action_args: {'id': 'fd224b68-1cc6-48cc-bcfe-a1ce40252e65'} Apr 14 16:05:38 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 16:05:38 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:05:38 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-7db39673-3988-48ae-98bd-7f71f47ea799 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Returning 404 to user: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:05:38 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-7db39673-3988-48ae-98bd-7f71f47ea799 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 404 len: 111 microversion: 2.1 time: 0.032865 Apr 14 16:05:38 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 306/921] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:05:38 2023] DELETE /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:05:38 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-80cbda45-7aa9-4b64-8975-9b130d3fcd4e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:38 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-80cbda45-7aa9-4b64-8975-9b130d3fcd4e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:05:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-80cbda45-7aa9-4b64-8975-9b130d3fcd4e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-80cbda45-7aa9-4b64-8975-9b130d3fcd4e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-80cbda45-7aa9-4b64-8975-9b130d3fcd4e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-80cbda45-7aa9-4b64-8975-9b130d3fcd4e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-80cbda45-7aa9-4b64-8975-9b130d3fcd4e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-80cbda45-7aa9-4b64-8975-9b130d3fcd4e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-80cbda45-7aa9-4b64-8975-9b130d3fcd4e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HTTP exception thrown: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 16:05:38 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-80cbda45-7aa9-4b64-8975-9b130d3fcd4e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Request method failure captured: Apr 14 16:05:38 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 HTTP/1.1 Apr 14 16:05:38 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:05:38 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:05:38 user devstack@n-api.service[61875]: Connection: close Apr 14 16:05:38 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:05:38 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:05:38 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:05:38 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:05:38 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXQCThpy3yl6l1TCWVl5qU9ObX9ml7vxjJ1brRtAPkbr5ZkdoJQff6z6UDjK5Q28yasEVG9HXQzHH37jgV5YNAsEJoMKFqOHBJp644GvPOnwDCBB71n3Hhn9EBLtM10HjdAX1t1mFB8pYmFsnraSY0KDD3eoZp0nTUBMTr6jHRO65Nw Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Project-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Project-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/95e26fa4727e46479d108fe49e225706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95e26fa4727e46479d108fe49e225706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Tenant: tempest-ServerActionsTestJSON-649148824 Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Tenant-Id: 95e26fa4727e46479d108fe49e225706 Apr 14 16:05:38 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-ServerActionsTestJSON-649148824 Apr 14 16:05:38 user devstack@n-api.service[61875]: X-User: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 16:05:38 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:05:38 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:05:38 user devstack@n-api.service[61875]: X-User-Id: 3062186c340a4cfe875d5455b0ace246 Apr 14 16:05:38 user devstack@n-api.service[61875]: X-User-Name: tempest-ServerActionsTestJSON-649148824-project-member Apr 14 16:05:38 user devstack@n-api.service[61875]: method: > Apr 14 16:05:38 user devstack@n-api.service[61875]: exception: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 16:05:38 user devstack@n-api.service[61875]: action_args: {'id': 'fd224b68-1cc6-48cc-bcfe-a1ce40252e65'} Apr 14 16:05:38 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. Apr 14 16:05:38 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:05:38 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-80cbda45-7aa9-4b64-8975-9b130d3fcd4e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Returning 404 to user: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:05:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-80cbda45-7aa9-4b64-8975-9b130d3fcd4e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65" status: 404 len: 111 microversion: 2.1 time: 0.050330 Apr 14 16:05:38 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 307/922] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:05:38 2023] GET /compute/v2.1/servers/fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:05:38 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-78ef87a8-d1b7-401f-af37-c363792fc611 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Calling method '.version_select at 0x7f29708677f0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:38 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-78ef87a8-d1b7-401f-af37-c363792fc611 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131359708" status: 202 len: 0 microversion: 2.1 time: 0.022403 Apr 14 16:05:38 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 310/923] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 16:05:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131359708 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:05:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=8 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-53bb7b7d-37fc-4ff2-898c-f9200531df27 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:59 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-53bb7b7d-37fc-4ff2-898c-f9200531df27 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:05:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-53bb7b7d-37fc-4ff2-898c-f9200531df27 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-53bb7b7d-37fc-4ff2-898c-f9200531df27 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-53bb7b7d-37fc-4ff2-898c-f9200531df27 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-53bb7b7d-37fc-4ff2-898c-f9200531df27 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-53bb7b7d-37fc-4ff2-898c-f9200531df27 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-53bb7b7d-37fc-4ff2-898c-f9200531df27 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:59 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-53bb7b7d-37fc-4ff2-898c-f9200531df27 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.228519 Apr 14 16:05:59 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 307/924] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 16:05:58 2023] GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff/os-volume_attachments => generated 25 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:05:59 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:59 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:05:59 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:59 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:59 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:59 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:59 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:05:59 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff" status: 204 len: 0 microversion: 2.1 time: 0.136918 Apr 14 16:05:59 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 308/925] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:05:59 2023] DELETE /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:05:59 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:59 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:05:59 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-7c42db02-2091-47ff-bc0c-36e8a0b173b2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:05:59 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-7c42db02-2091-47ff-bc0c-36e8a0b173b2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:05:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c42db02-2091-47ff-bc0c-36e8a0b173b2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c42db02-2091-47ff-bc0c-36e8a0b173b2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c42db02-2091-47ff-bc0c-36e8a0b173b2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c42db02-2091-47ff-bc0c-36e8a0b173b2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c42db02-2091-47ff-bc0c-36e8a0b173b2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c42db02-2091-47ff-bc0c-36e8a0b173b2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:59 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-381543e2-7206-48b5-8b29-c0f53e589dd1 req-0d8a76b3-0d95-4737-87ff-a0b4681f97f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85ad8a8f-d9e8-4f74-a16f-449616e970ff", "name": "network-vif-unplugged", "status": "completed", "tag": "32081ce5-b63b-4a2d-9150-5c4d235a8b28"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:05:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-381543e2-7206-48b5-8b29-c0f53e589dd1 req-0d8a76b3-0d95-4737-87ff-a0b4681f97f0 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:05:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-381543e2-7206-48b5-8b29-c0f53e589dd1 req-0d8a76b3-0d95-4737-87ff-a0b4681f97f0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:05:59 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-381543e2-7206-48b5-8b29-c0f53e589dd1 req-0d8a76b3-0d95-4737-87ff-a0b4681f97f0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:05:59 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-7c42db02-2091-47ff-bc0c-36e8a0b173b2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:05:59 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-381543e2-7206-48b5-8b29-c0f53e589dd1 req-0d8a76b3-0d95-4737-87ff-a0b4681f97f0 service nova] Creating event network-vif-unplugged:32081ce5-b63b-4a2d-9150-5c4d235a8b28 for instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff on user Apr 14 16:05:59 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-7c42db02-2091-47ff-bc0c-36e8a0b173b2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff" status: 200 len: 1667 microversion: 2.1 time: 0.292085 Apr 14 16:05:59 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 311/926] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:05:59 2023] GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff => generated 1667 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:05:59 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-381543e2-7206-48b5-8b29-c0f53e589dd1 req-0d8a76b3-0d95-4737-87ff-a0b4681f97f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098631 Apr 14 16:05:59 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 308/927] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:05:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:06:01 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-81ffe1e5-3bd1-4904-8556-04b7fab8683a req-f80ce610-2a13-428f-b4dd-6067432db267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85ad8a8f-d9e8-4f74-a16f-449616e970ff", "name": "network-vif-deleted", "tag": "32081ce5-b63b-4a2d-9150-5c4d235a8b28"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:06:01 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-81ffe1e5-3bd1-4904-8556-04b7fab8683a req-f80ce610-2a13-428f-b4dd-6067432db267 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:01 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-81ffe1e5-3bd1-4904-8556-04b7fab8683a req-f80ce610-2a13-428f-b4dd-6067432db267 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:01 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-81ffe1e5-3bd1-4904-8556-04b7fab8683a req-f80ce610-2a13-428f-b4dd-6067432db267 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:01 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-81ffe1e5-3bd1-4904-8556-04b7fab8683a req-f80ce610-2a13-428f-b4dd-6067432db267 service nova] Creating event network-vif-deleted:32081ce5-b63b-4a2d-9150-5c4d235a8b28 for instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff on user Apr 14 16:06:01 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-81ffe1e5-3bd1-4904-8556-04b7fab8683a req-f80ce610-2a13-428f-b4dd-6067432db267 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034639 Apr 14 16:06:01 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 309/928] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:06:01 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-5ab949c8-7064-43a8-bd2f-afd490eb3847 req-79577aa9-3c4b-4396-84ca-2765dc44fd26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85ad8a8f-d9e8-4f74-a16f-449616e970ff", "name": "network-vif-plugged", "status": "completed", "tag": "32081ce5-b63b-4a2d-9150-5c4d235a8b28"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:06:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-5ab949c8-7064-43a8-bd2f-afd490eb3847 req-79577aa9-3c4b-4396-84ca-2765dc44fd26 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-5ab949c8-7064-43a8-bd2f-afd490eb3847 req-79577aa9-3c4b-4396-84ca-2765dc44fd26 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-5ab949c8-7064-43a8-bd2f-afd490eb3847 req-79577aa9-3c4b-4396-84ca-2765dc44fd26 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-5ab949c8-7064-43a8-bd2f-afd490eb3847 req-79577aa9-3c4b-4396-84ca-2765dc44fd26 service nova] Creating event network-vif-plugged:32081ce5-b63b-4a2d-9150-5c4d235a8b28 for instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff on user Apr 14 16:06:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-5ab949c8-7064-43a8-bd2f-afd490eb3847 req-79577aa9-3c4b-4396-84ca-2765dc44fd26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030364 Apr 14 16:06:01 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 312/929] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:06:20 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:20 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=8 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:20 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-6c141824-4c73-48b1-bc86-bfc567d2fbe3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:06:20 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-6c141824-4c73-48b1-bc86-bfc567d2fbe3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:06:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6c141824-4c73-48b1-bc86-bfc567d2fbe3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6c141824-4c73-48b1-bc86-bfc567d2fbe3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6c141824-4c73-48b1-bc86-bfc567d2fbe3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6c141824-4c73-48b1-bc86-bfc567d2fbe3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6c141824-4c73-48b1-bc86-bfc567d2fbe3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6c141824-4c73-48b1-bc86-bfc567d2fbe3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:20 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-6c141824-4c73-48b1-bc86-bfc567d2fbe3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:06:20 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-6c141824-4c73-48b1-bc86-bfc567d2fbe3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:06:20 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-6c141824-4c73-48b1-bc86-bfc567d2fbe3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:06:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-6c141824-4c73-48b1-bc86-bfc567d2fbe3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38" status: 200 len: 1587 microversion: 2.20 time: 0.229877 Apr 14 16:06:20 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 309/930] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:06:20 2023] GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 => generated 1587 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:06:23 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:23 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:24 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b6a16a7a-e104-4058-9631-a29464cd1ef5 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Action: 'create', calling method: .version_select at 0x7f2970a47760>, body: {"keypair": {"name": "tempest-TestShelveInstance-163308382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIVqE9fEVycFAK+Gh/+LweMpamRDIGnhFfG42+5HdOWX1XdC8hGLSoifG92sxHHVA8mRsvZgr42YuaW4sLfHJ80/IMh3TNaLl+E7j32V5F75cszy3PrR7bTxzkPUUbDYg=="}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:06:24 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-b6a16a7a-e104-4058-9631-a29464cd1ef5 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Getting quotas for project 0f145f9471aa46ab88e93a9d4c7a4535. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:06:24 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-b6a16a7a-e104-4058-9631-a29464cd1ef5 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Getting quotas for user ca751b25580040a2b48039142c91d58f and project 0f145f9471aa46ab88e93a9d4c7a4535. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:06:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-b6a16a7a-e104-4058-9631-a29464cd1ef5 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.288953 Apr 14 16:06:24 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 310/931] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 16:06:23 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-491913355", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-163308382", "security_groups": [{"name": "tempest-secgroup-smoke-2143244588"}], "networks": [{"uuid": "1638ee72-d25e-4900-bfa3-d13dee7504d6"}], "block_device_mapping_v2": [{"uuid": "2947891b-11ba-4dc1-9435-83fe187e0f04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] validate_networks() for [('1638ee72-d25e-4900-bfa3-d13dee7504d6', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Getting quotas for project 0f145f9471aa46ab88e93a9d4c7a4535. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Getting quotas for user ca751b25580040a2b48039142c91d58f and project 0f145f9471aa46ab88e93a9d4c7a4535. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:06:29 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2947891b-11ba-4dc1-9435-83fe187e0f04',volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:06:30 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.865002 Apr 14 16:06:30 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 313/932] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:06:29 2023] POST /compute/v2.1/servers => generated 404 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:06:30 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-c2b594c9-7cca-4a39-9d79-4c5b560af231 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:06:30 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-c2b594c9-7cca-4a39-9d79-4c5b560af231 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:06:30 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-c2b594c9-7cca-4a39-9d79-4c5b560af231 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca751b25580040a2b48039142c91d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f145f9471aa46ab88e93a9d4c7a4535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:06:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-c2b594c9-7cca-4a39-9d79-4c5b560af231 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57" status: 200 len: 1082 microversion: 2.1 time: 0.059274 Apr 14 16:06:30 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 310/933] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:06:30 2023] GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => generated 1082 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:06:32 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:06:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] Creating event network-changed:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:06:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031159 Apr 14 16:06:32 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 311/934] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:06:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:06:39 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-6d4ae6b7-d601-4cfe-9343-cd798a426824 req-773e8e1f-e675-4bd6-bae0-5341816bb0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "name": "network-vif-plugged", "status": "completed", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:06:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6d4ae6b7-d601-4cfe-9343-cd798a426824 req-773e8e1f-e675-4bd6-bae0-5341816bb0e1 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6d4ae6b7-d601-4cfe-9343-cd798a426824 req-773e8e1f-e675-4bd6-bae0-5341816bb0e1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-6d4ae6b7-d601-4cfe-9343-cd798a426824 req-773e8e1f-e675-4bd6-bae0-5341816bb0e1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:39 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-6d4ae6b7-d601-4cfe-9343-cd798a426824 req-773e8e1f-e675-4bd6-bae0-5341816bb0e1 service nova] Creating event network-vif-plugged:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:06:39 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-6d4ae6b7-d601-4cfe-9343-cd798a426824 req-773e8e1f-e675-4bd6-bae0-5341816bb0e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050377 Apr 14 16:06:39 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 314/935] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:06:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:06:41 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:41 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:41 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:41 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-8f505824-f87f-4493-9252-d9680e99d80b req-d0f7a106-31ab-4c84-9795-b21b215e5541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "name": "network-vif-plugged", "status": "completed", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:06:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-8f505824-f87f-4493-9252-d9680e99d80b req-d0f7a106-31ab-4c84-9795-b21b215e5541 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-8f505824-f87f-4493-9252-d9680e99d80b req-d0f7a106-31ab-4c84-9795-b21b215e5541 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-8f505824-f87f-4493-9252-d9680e99d80b req-d0f7a106-31ab-4c84-9795-b21b215e5541 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-8f505824-f87f-4493-9252-d9680e99d80b req-d0f7a106-31ab-4c84-9795-b21b215e5541 service nova] Creating event network-vif-plugged:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:06:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-8f505824-f87f-4493-9252-d9680e99d80b req-d0f7a106-31ab-4c84-9795-b21b215e5541 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040214 Apr 14 16:06:41 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 311/936] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:06:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:06:49 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:49 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:49 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:49 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f6ea23a1-f190-493b-8783-2d022a3e7ca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:06:49 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-f6ea23a1-f190-493b-8783-2d022a3e7ca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:06:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f6ea23a1-f190-493b-8783-2d022a3e7ca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f6ea23a1-f190-493b-8783-2d022a3e7ca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f6ea23a1-f190-493b-8783-2d022a3e7ca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f6ea23a1-f190-493b-8783-2d022a3e7ca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f6ea23a1-f190-493b-8783-2d022a3e7ca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f6ea23a1-f190-493b-8783-2d022a3e7ca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-f6ea23a1-f190-493b-8783-2d022a3e7ca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:06:49 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f6ea23a1-f190-493b-8783-2d022a3e7ca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:06:49 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff HTTP/1.1 Apr 14 16:06:49 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:06:49 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:06:49 user devstack@n-api.service[61875]: Connection: close Apr 14 16:06:49 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:06:49 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:06:49 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:06:49 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:06:49 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:06:49 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:06:49 user devstack@n-api.service[61875]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:06:49 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:06:49 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:06:49 user devstack@n-api.service[61875]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:06:49 user devstack@n-api.service[61875]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:06:49 user devstack@n-api.service[61875]: method: > Apr 14 16:06:49 user devstack@n-api.service[61875]: exception: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:06:49 user devstack@n-api.service[61875]: action_args: {'id': '85ad8a8f-d9e8-4f74-a16f-449616e970ff'} Apr 14 16:06:49 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:06:49 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:06:49 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f6ea23a1-f190-493b-8783-2d022a3e7ca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 404 to user: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:06:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-f6ea23a1-f190-493b-8783-2d022a3e7ca9 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff" status: 404 len: 111 microversion: 2.1 time: 0.038733 Apr 14 16:06:49 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 312/937] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:06:49 2023] GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:06:49 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-d44fe21c-d015-4f91-a720-1cf68eb53c10 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '.version_select at 0x7f2970866440>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:06:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:49 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-d44fe21c-d015-4f91-a720-1cf68eb53c10 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93023126" status: 202 len: 0 microversion: 2.1 time: 0.030940 Apr 14 16:06:49 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 315/938] 10.0.0.210 () {62 vars in 1292 bytes} [Fri Apr 14 16:06:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93023126 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:06:50 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-73880510-1f97-4ef8-acde-f4edf2dc6f43 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Action: 'create', calling method: .version_select at 0x7f2970871e10>, body: {"keypair": {"name": "tempest-keypair-388847104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdQGyEZxcMTFif2Fb0VzDaFXGQPiXG8GLAWmvhsMb1cuzmisMXAkf9eWnBOu3OuqWPsVR66YcTHn/BD+yPOOCjhzbuxyiGr8oalwYLWVgmWBAGVr6EoWbycD+FNaOa84A=="}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:06:50 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-73880510-1f97-4ef8-acde-f4edf2dc6f43 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for project ecb4d204dbf24c19b978456d16d19e87. Resources: {'key_pairs'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:06:50 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-73880510-1f97-4ef8-acde-f4edf2dc6f43 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for user 2d83796cd8d5464fa4e580844441da81 and project ecb4d204dbf24c19b978456d16d19e87. Resources: {'key_pairs'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:06:50 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-73880510-1f97-4ef8-acde-f4edf2dc6f43 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043648 Apr 14 16:06:50 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 312/939] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 16:06:50 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:06:51 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-968788151", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "5deec755-9819-4003-820a-2b9360f5dc62"}], "security_groups": [{"name": "tempest-securitygroup--1034396453"}], "key_name": "tempest-keypair-388847104", "user_data": "}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:06:51 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] validate_networks() for [('5deec755-9819-4003-820a-2b9360f5dc62', None, None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for project ecb4d204dbf24c19b978456d16d19e87. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for user 2d83796cd8d5464fa4e580844441da81 and project ecb4d204dbf24c19b978456d16d19e87. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:06:52 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:06:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.645345 Apr 14 16:06:52 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 313/940] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:06:51 2023] POST /compute/v2.1/servers => generated 400 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:06:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-a432a59c-db3d-402f-81d3-b5b5a8624cca tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:06:52 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-a432a59c-db3d-402f-81d3-b5b5a8624cca tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:06:52 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-a432a59c-db3d-402f-81d3-b5b5a8624cca tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:06:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-a432a59c-db3d-402f-81d3-b5b5a8624cca tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611" status: 200 len: 1234 microversion: 2.1 time: 0.066132 Apr 14 16:06:52 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 316/941] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:06:52 2023] GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611 => generated 1234 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:06:54 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "971c41c2-4757-4a9c-bef7-aff8b6386611", "tag": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:06:54 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:06:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:55 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] Creating event network-changed:36f4a46b-0cb2-4a15-b995-43b84aa8d86a for instance 971c41c2-4757-4a9c-bef7-aff8b6386611 on user Apr 14 16:06:55 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035401 Apr 14 16:06:55 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 313/942] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:06:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:06:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-7432fc90-222f-4ee4-8672-c04e078e72fa req-baa71c4b-66d1-4cc8-b492-1dbf27ad5f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971c41c2-4757-4a9c-bef7-aff8b6386611", "name": "network-vif-plugged", "status": "completed", "tag": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:06:57 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7432fc90-222f-4ee4-8672-c04e078e72fa req-baa71c4b-66d1-4cc8-b492-1dbf27ad5f80 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:57 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7432fc90-222f-4ee4-8672-c04e078e72fa req-baa71c4b-66d1-4cc8-b492-1dbf27ad5f80 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:57 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7432fc90-222f-4ee4-8672-c04e078e72fa req-baa71c4b-66d1-4cc8-b492-1dbf27ad5f80 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-7432fc90-222f-4ee4-8672-c04e078e72fa req-baa71c4b-66d1-4cc8-b492-1dbf27ad5f80 service nova] Creating event network-vif-plugged:36f4a46b-0cb2-4a15-b995-43b84aa8d86a for instance 971c41c2-4757-4a9c-bef7-aff8b6386611 on user Apr 14 16:06:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-7432fc90-222f-4ee4-8672-c04e078e72fa req-baa71c4b-66d1-4cc8-b492-1dbf27ad5f80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039732 Apr 14 16:06:57 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 314/943] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:06:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:06:59 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-27390f0c-d1a0-488f-aa47-79005ae089b4 req-519c0cd2-7614-4155-9f43-8d92688ead5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971c41c2-4757-4a9c-bef7-aff8b6386611", "name": "network-vif-plugged", "status": "completed", "tag": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:06:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-27390f0c-d1a0-488f-aa47-79005ae089b4 req-519c0cd2-7614-4155-9f43-8d92688ead5c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:06:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-27390f0c-d1a0-488f-aa47-79005ae089b4 req-519c0cd2-7614-4155-9f43-8d92688ead5c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:06:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-27390f0c-d1a0-488f-aa47-79005ae089b4 req-519c0cd2-7614-4155-9f43-8d92688ead5c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:06:59 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-27390f0c-d1a0-488f-aa47-79005ae089b4 req-519c0cd2-7614-4155-9f43-8d92688ead5c service nova] Creating event network-vif-plugged:36f4a46b-0cb2-4a15-b995-43b84aa8d86a for instance 971c41c2-4757-4a9c-bef7-aff8b6386611 on user Apr 14 16:06:59 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-27390f0c-d1a0-488f-aa47-79005ae089b4 req-519c0cd2-7614-4155-9f43-8d92688ead5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034268 Apr 14 16:06:59 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 317/944] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:06:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:07:20 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:07:20 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:07:20 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:07:20 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-dff5d394-bad4-4069-a881-6f6ba53b9d5c tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:07:20 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-dff5d394-bad4-4069-a881-6f6ba53b9d5c tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:07:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-dff5d394-bad4-4069-a881-6f6ba53b9d5c tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-dff5d394-bad4-4069-a881-6f6ba53b9d5c tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-dff5d394-bad4-4069-a881-6f6ba53b9d5c tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-dff5d394-bad4-4069-a881-6f6ba53b9d5c tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-dff5d394-bad4-4069-a881-6f6ba53b9d5c tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-dff5d394-bad4-4069-a881-6f6ba53b9d5c tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:20 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-dff5d394-bad4-4069-a881-6f6ba53b9d5c tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca751b25580040a2b48039142c91d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f145f9471aa46ab88e93a9d4c7a4535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:07:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-dff5d394-bad4-4069-a881-6f6ba53b9d5c tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57" status: 200 len: 1432 microversion: 2.1 time: 0.222709 Apr 14 16:07:20 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 314/945] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:07:20 2023] GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => generated 1432 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:07:20 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:07:20 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:07:20 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:07:20 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:07:20 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-e26b2319-4ecb-49aa-b843-a7320cd49c68 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:07:20 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-e26b2319-4ecb-49aa-b843-a7320cd49c68 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:07:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e26b2319-4ecb-49aa-b843-a7320cd49c68 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e26b2319-4ecb-49aa-b843-a7320cd49c68 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e26b2319-4ecb-49aa-b843-a7320cd49c68 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e26b2319-4ecb-49aa-b843-a7320cd49c68 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e26b2319-4ecb-49aa-b843-a7320cd49c68 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:20 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e26b2319-4ecb-49aa-b843-a7320cd49c68 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:21 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-e26b2319-4ecb-49aa-b843-a7320cd49c68 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.179087 Apr 14 16:07:21 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 315/946] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 16:07:20 2023] GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/os-interface => generated 283 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:07:22 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:07:22 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:07:22 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:07:22 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89cb156f-a586-4206-b995-999ebca99f38", "tag": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:07:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:22 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] Creating event network-changed:4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance 89cb156f-a586-4206-b995-999ebca99f38 on user Apr 14 16:07:22 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037454 Apr 14 16:07:22 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 318/947] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:07:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:07:22 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-1bccc125-2648-4fa3-836b-5767552fb0c9 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:07:22 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-1bccc125-2648-4fa3-836b-5767552fb0c9 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:07:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1bccc125-2648-4fa3-836b-5767552fb0c9 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1bccc125-2648-4fa3-836b-5767552fb0c9 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1bccc125-2648-4fa3-836b-5767552fb0c9 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1bccc125-2648-4fa3-836b-5767552fb0c9 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1bccc125-2648-4fa3-836b-5767552fb0c9 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1bccc125-2648-4fa3-836b-5767552fb0c9 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:22 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-1bccc125-2648-4fa3-836b-5767552fb0c9 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/ips" status: 200 len: 111 microversion: 2.20 time: 0.040430 Apr 14 16:07:22 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 315/948] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 16:07:22 2023] GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/ips => generated 111 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:07:24 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:07:24 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:07:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:24 user devstack@n-api.service[61875]: DEBUG nova.objects.instance [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'flavor' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=61875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 16:07:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "POST /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/action" status: 202 len: 0 microversion: 2.20 time: 0.859642 Apr 14 16:07:25 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 316/949] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 16:07:24 2023] POST /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/action => generated 0 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:07:25 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-8dba567f-a23f-49ee-80c4-ce8e7fcc5458 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:07:25 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-8dba567f-a23f-49ee-80c4-ce8e7fcc5458 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:07:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8dba567f-a23f-49ee-80c4-ce8e7fcc5458 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8dba567f-a23f-49ee-80c4-ce8e7fcc5458 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8dba567f-a23f-49ee-80c4-ce8e7fcc5458 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8dba567f-a23f-49ee-80c4-ce8e7fcc5458 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8dba567f-a23f-49ee-80c4-ce8e7fcc5458 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8dba567f-a23f-49ee-80c4-ce8e7fcc5458 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:25 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-8dba567f-a23f-49ee-80c4-ce8e7fcc5458 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:07:25 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-8dba567f-a23f-49ee-80c4-ce8e7fcc5458 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:07:25 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-8dba567f-a23f-49ee-80c4-ce8e7fcc5458 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:07:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-8dba567f-a23f-49ee-80c4-ce8e7fcc5458 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38" status: 200 len: 1712 microversion: 2.20 time: 0.272210 Apr 14 16:07:25 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 319/950] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:07:25 2023] GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 => generated 1712 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:07:25 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-1e471187-0c36-42d9-9c8e-f4b7bc49491c req-74df639c-175e-4658-ac00-d50ee62a2efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cb156f-a586-4206-b995-999ebca99f38", "name": "network-vif-unplugged", "status": "completed", "tag": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:07:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1e471187-0c36-42d9-9c8e-f4b7bc49491c req-74df639c-175e-4658-ac00-d50ee62a2efe service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1e471187-0c36-42d9-9c8e-f4b7bc49491c req-74df639c-175e-4658-ac00-d50ee62a2efe service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:25 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-1e471187-0c36-42d9-9c8e-f4b7bc49491c req-74df639c-175e-4658-ac00-d50ee62a2efe service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-1e471187-0c36-42d9-9c8e-f4b7bc49491c req-74df639c-175e-4658-ac00-d50ee62a2efe service nova] Creating event network-vif-unplugged:4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance 89cb156f-a586-4206-b995-999ebca99f38 on user Apr 14 16:07:25 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-1e471187-0c36-42d9-9c8e-f4b7bc49491c req-74df639c-175e-4658-ac00-d50ee62a2efe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029379 Apr 14 16:07:25 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 316/951] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:07:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:07:27 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-9c511ece-d57e-4ade-ab2c-1d97d43ddb9b req-8b745052-264b-4a72-b3b4-2eaedf010e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cb156f-a586-4206-b995-999ebca99f38", "name": "network-vif-plugged", "status": "completed", "tag": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:07:27 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-9c511ece-d57e-4ade-ab2c-1d97d43ddb9b req-8b745052-264b-4a72-b3b4-2eaedf010e0f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:27 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-9c511ece-d57e-4ade-ab2c-1d97d43ddb9b req-8b745052-264b-4a72-b3b4-2eaedf010e0f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:27 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-9c511ece-d57e-4ade-ab2c-1d97d43ddb9b req-8b745052-264b-4a72-b3b4-2eaedf010e0f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:27 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-9c511ece-d57e-4ade-ab2c-1d97d43ddb9b req-8b745052-264b-4a72-b3b4-2eaedf010e0f service nova] Creating event network-vif-plugged:4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance 89cb156f-a586-4206-b995-999ebca99f38 on user Apr 14 16:07:27 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-9c511ece-d57e-4ade-ab2c-1d97d43ddb9b req-8b745052-264b-4a72-b3b4-2eaedf010e0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030370 Apr 14 16:07:27 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 317/952] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:07:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:07:30 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89cb156f-a586-4206-b995-999ebca99f38", "tag": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:07:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:30 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] Creating event network-changed:4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance 89cb156f-a586-4206-b995-999ebca99f38 on user Apr 14 16:07:30 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027748 Apr 14 16:07:30 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 320/953] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:07:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:07:42 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:07:42 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=12 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:07:42 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-a2119a50-9608-421c-8bc8-2bd2f205b0a7 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:07:42 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-a2119a50-9608-421c-8bc8-2bd2f205b0a7 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:07:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a2119a50-9608-421c-8bc8-2bd2f205b0a7 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a2119a50-9608-421c-8bc8-2bd2f205b0a7 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a2119a50-9608-421c-8bc8-2bd2f205b0a7 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a2119a50-9608-421c-8bc8-2bd2f205b0a7 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:07:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a2119a50-9608-421c-8bc8-2bd2f205b0a7 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:07:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-a2119a50-9608-421c-8bc8-2bd2f205b0a7 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:07:42 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-a2119a50-9608-421c-8bc8-2bd2f205b0a7 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:07:42 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-a2119a50-9608-421c-8bc8-2bd2f205b0a7 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611" status: 200 len: 1545 microversion: 2.1 time: 0.282771 Apr 14 16:07:42 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 317/954] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:07:42 2023] GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611 => generated 1545 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:08:15 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:15 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:15 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a1848068-8ca6-498f-9293-b43eac2a2090 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:08:15 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a1848068-8ca6-498f-9293-b43eac2a2090 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:08:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a1848068-8ca6-498f-9293-b43eac2a2090 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a1848068-8ca6-498f-9293-b43eac2a2090 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a1848068-8ca6-498f-9293-b43eac2a2090 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a1848068-8ca6-498f-9293-b43eac2a2090 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a1848068-8ca6-498f-9293-b43eac2a2090 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a1848068-8ca6-498f-9293-b43eac2a2090 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:16 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-a1848068-8ca6-498f-9293-b43eac2a2090 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:08:16 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-a1848068-8ca6-498f-9293-b43eac2a2090 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:08:16 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-a1848068-8ca6-498f-9293-b43eac2a2090 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:08:16 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a1848068-8ca6-498f-9293-b43eac2a2090 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38" status: 200 len: 1653 microversion: 2.20 time: 0.278357 Apr 14 16:08:16 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 318/955] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:08:15 2023] GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 => generated 1653 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:08:20 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:20 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=10 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:20 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-725c3ac3-dfed-4412-90d4-6be94b26a3c6 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:08:20 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-725c3ac3-dfed-4412-90d4-6be94b26a3c6 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:08:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-725c3ac3-dfed-4412-90d4-6be94b26a3c6 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-725c3ac3-dfed-4412-90d4-6be94b26a3c6 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-725c3ac3-dfed-4412-90d4-6be94b26a3c6 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-725c3ac3-dfed-4412-90d4-6be94b26a3c6 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-725c3ac3-dfed-4412-90d4-6be94b26a3c6 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-725c3ac3-dfed-4412-90d4-6be94b26a3c6 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:20 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-725c3ac3-dfed-4412-90d4-6be94b26a3c6 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca751b25580040a2b48039142c91d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f145f9471aa46ab88e93a9d4c7a4535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:08:20 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-725c3ac3-dfed-4412-90d4-6be94b26a3c6 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57" status: 200 len: 1432 microversion: 2.1 time: 0.216501 Apr 14 16:08:20 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 321/956] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:08:20 2023] GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => generated 1432 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:08:22 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:08:22 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:22 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:22 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:22 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] Creating event network-changed:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:08:22 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037216 Apr 14 16:08:22 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 318/957] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:08:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:08:22 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:08:22 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:08:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:22 user devstack@n-api.service[61875]: DEBUG nova.objects.instance [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lazy-loading 'flavor' on Instance uuid 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 {{(pid=61875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 16:08:22 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57/action" status: 202 len: 0 microversion: 2.1 time: 0.142791 Apr 14 16:08:22 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 319/958] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 16:08:22 2023] POST /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:08:22 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-2af77c61-913a-47eb-986e-a79a5e6373ec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:08:22 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-2af77c61-913a-47eb-986e-a79a5e6373ec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:08:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2af77c61-913a-47eb-986e-a79a5e6373ec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2af77c61-913a-47eb-986e-a79a5e6373ec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2af77c61-913a-47eb-986e-a79a5e6373ec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2af77c61-913a-47eb-986e-a79a5e6373ec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2af77c61-913a-47eb-986e-a79a5e6373ec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:22 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-2af77c61-913a-47eb-986e-a79a5e6373ec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:23 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-2af77c61-913a-47eb-986e-a79a5e6373ec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca751b25580040a2b48039142c91d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f145f9471aa46ab88e93a9d4c7a4535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:08:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-2af77c61-913a-47eb-986e-a79a5e6373ec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57" status: 200 len: 1438 microversion: 2.1 time: 0.182110 Apr 14 16:08:23 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 322/959] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:08:22 2023] GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => generated 1438 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:08:23 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-930173e4-c679-4a69-9751-9323a6ae9e4f req-5e408056-5ad4-4f0b-8f61-b7a98ed83c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "name": "network-vif-unplugged", "status": "completed", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:08:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-930173e4-c679-4a69-9751-9323a6ae9e4f req-5e408056-5ad4-4f0b-8f61-b7a98ed83c9d service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-930173e4-c679-4a69-9751-9323a6ae9e4f req-5e408056-5ad4-4f0b-8f61-b7a98ed83c9d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-930173e4-c679-4a69-9751-9323a6ae9e4f req-5e408056-5ad4-4f0b-8f61-b7a98ed83c9d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:23 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-930173e4-c679-4a69-9751-9323a6ae9e4f req-5e408056-5ad4-4f0b-8f61-b7a98ed83c9d service nova] Creating event network-vif-unplugged:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:08:23 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-930173e4-c679-4a69-9751-9323a6ae9e4f req-5e408056-5ad4-4f0b-8f61-b7a98ed83c9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032308 Apr 14 16:08:23 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 319/960] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:08:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:08:24 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:08:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] Creating event network-changed:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:08:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041272 Apr 14 16:08:24 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 320/961] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:08:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:08:25 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "name": "network-vif-plugged", "status": "completed", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}, {"server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "name": "network-vif-plugged", "status": "completed", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}, {"server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "name": "network-vif-plugged", "status": "completed", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}, {"server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "name": "network-vif-unplugged", "status": "completed", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}, {"server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "name": "network-vif-plugged", "status": "completed", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:08:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:25 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Creating event network-vif-plugged:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:08:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Creating event network-vif-plugged:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:08:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Creating event network-vif-plugged:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:08:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Creating event network-vif-unplugged:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:08:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Creating event network-vif-plugged:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:08:25 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.032654 Apr 14 16:08:25 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 323/962] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:08:25 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:08:42 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:42 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:42 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-1c62eec8-9049-4244-b748-0f16a613f3d0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:08:42 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-1c62eec8-9049-4244-b748-0f16a613f3d0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:08:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1c62eec8-9049-4244-b748-0f16a613f3d0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1c62eec8-9049-4244-b748-0f16a613f3d0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1c62eec8-9049-4244-b748-0f16a613f3d0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1c62eec8-9049-4244-b748-0f16a613f3d0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1c62eec8-9049-4244-b748-0f16a613f3d0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-1c62eec8-9049-4244-b748-0f16a613f3d0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:43 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-1c62eec8-9049-4244-b748-0f16a613f3d0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.195880 Apr 14 16:08:43 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 320/963] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 16:08:42 2023] GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/os-interface => generated 283 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:08:44 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:44 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:44 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "971c41c2-4757-4a9c-bef7-aff8b6386611", "tag": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:08:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:44 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:44 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] Creating event network-changed:36f4a46b-0cb2-4a15-b995-43b84aa8d86a for instance 971c41c2-4757-4a9c-bef7-aff8b6386611 on user Apr 14 16:08:44 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041484 Apr 14 16:08:44 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 321/964] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:08:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:08:44 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:44 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=14 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:44 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-a7027fc2-6c07-44c1-9896-473fc440de5f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:08:44 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-a7027fc2-6c07-44c1-9896-473fc440de5f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:08:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a7027fc2-6c07-44c1-9896-473fc440de5f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a7027fc2-6c07-44c1-9896-473fc440de5f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a7027fc2-6c07-44c1-9896-473fc440de5f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a7027fc2-6c07-44c1-9896-473fc440de5f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a7027fc2-6c07-44c1-9896-473fc440de5f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a7027fc2-6c07-44c1-9896-473fc440de5f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:44 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-a7027fc2-6c07-44c1-9896-473fc440de5f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/ips" status: 200 len: 109 microversion: 2.1 time: 0.043680 Apr 14 16:08:44 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 324/965] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 16:08:44 2023] GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/ips => generated 109 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:08:46 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:08:46 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:08:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:46 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:46 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306352 Apr 14 16:08:46 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 321/966] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 16:08:46 2023] POST /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:08:56 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c6783095-3699-414d-9450-597899dfbadf tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:08:56 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-c6783095-3699-414d-9450-597899dfbadf tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:08:56 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:56 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c6783095-3699-414d-9450-597899dfbadf tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c6783095-3699-414d-9450-597899dfbadf tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c6783095-3699-414d-9450-597899dfbadf tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c6783095-3699-414d-9450-597899dfbadf tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c6783095-3699-414d-9450-597899dfbadf tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c6783095-3699-414d-9450-597899dfbadf tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-c6783095-3699-414d-9450-597899dfbadf tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Invalid volume: volume cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d is already attached to instances: 971c41c2-4757-4a9c-bef7-aff8b6386611 Apr 14 16:08:56 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c6783095-3699-414d-9450-597899dfbadf tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:08:56 user devstack@n-api.service[61875]: request: POST /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/os-volume_attachments HTTP/1.1 Apr 14 16:08:56 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:08:56 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:08:56 user devstack@n-api.service[61875]: Connection: close Apr 14 16:08:56 user devstack@n-api.service[61875]: Content-Length: 74 Apr 14 16:08:56 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:08:56 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:08:56 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:08:56 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:08:56 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:08:56 user devstack@n-api.service[61875]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:08:56 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:08:56 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:08:56 user devstack@n-api.service[61875]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:08:56 user devstack@n-api.service[61875]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:08:56 user devstack@n-api.service[61875]: Apr 14 16:08:56 user devstack@n-api.service[61875]: {"volumeAttachment": {"volumeId": "cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d"}} Apr 14 16:08:56 user devstack@n-api.service[61875]: method: > Apr 14 16:08:56 user devstack@n-api.service[61875]: exception: Invalid volume: volume cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d is already attached to instances: 971c41c2-4757-4a9c-bef7-aff8b6386611 Apr 14 16:08:56 user devstack@n-api.service[61875]: action_args: {'server_id': '971c41c2-4757-4a9c-bef7-aff8b6386611', 'body': {'volumeAttachment': {'volumeId': 'cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d'}}} Apr 14 16:08:56 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d is already attached to instances: 971c41c2-4757-4a9c-bef7-aff8b6386611 Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d is already attached to instances: 971c41c2-4757-4a9c-bef7-aff8b6386611 Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d is already attached to instances: 971c41c2-4757-4a9c-bef7-aff8b6386611 Apr 14 16:08:56 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:08:56 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c6783095-3699-414d-9450-597899dfbadf tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 400 to user: Invalid volume: volume cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d is already attached to instances: 971c41c2-4757-4a9c-bef7-aff8b6386611 {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:08:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-c6783095-3699-414d-9450-597899dfbadf tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.228493 Apr 14 16:08:56 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 322/967] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 16:08:56 2023] POST /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/os-volume_attachments => generated 174 bytes in 230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:08:56 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:08:56 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:08:56 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:56 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:56 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'services' on Instance uuid 971c41c2-4757-4a9c-bef7-aff8b6386611 {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 16:08:56 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/os-volume_attachments/cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d" status: 202 len: 0 microversion: 2.1 time: 0.159461 Apr 14 16:08:56 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 325/968] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 16:08:56 2023] DELETE /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/os-volume_attachments/cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:08:56 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:56 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:08:56 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-fd619edc-3053-43fa-b244-0e468fdc8b23 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:08:56 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-fd619edc-3053-43fa-b244-0e468fdc8b23 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:08:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fd619edc-3053-43fa-b244-0e468fdc8b23 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fd619edc-3053-43fa-b244-0e468fdc8b23 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fd619edc-3053-43fa-b244-0e468fdc8b23 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fd619edc-3053-43fa-b244-0e468fdc8b23 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:08:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fd619edc-3053-43fa-b244-0e468fdc8b23 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:08:57 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fd619edc-3053-43fa-b244-0e468fdc8b23 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:08:57 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-fd619edc-3053-43fa-b244-0e468fdc8b23 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059370 Apr 14 16:08:57 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 322/969] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 16:08:56 2023] GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:09:13 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:09:13 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:09:13 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-7a7e2a86-70f3-4d2e-9897-73f6f4190eec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:09:13 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-7a7e2a86-70f3-4d2e-9897-73f6f4190eec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:09:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7a7e2a86-70f3-4d2e-9897-73f6f4190eec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7a7e2a86-70f3-4d2e-9897-73f6f4190eec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7a7e2a86-70f3-4d2e-9897-73f6f4190eec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7a7e2a86-70f3-4d2e-9897-73f6f4190eec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7a7e2a86-70f3-4d2e-9897-73f6f4190eec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-7a7e2a86-70f3-4d2e-9897-73f6f4190eec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:13 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-7a7e2a86-70f3-4d2e-9897-73f6f4190eec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca751b25580040a2b48039142c91d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f145f9471aa46ab88e93a9d4c7a4535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:09:13 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-7a7e2a86-70f3-4d2e-9897-73f6f4190eec tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57" status: 200 len: 1497 microversion: 2.1 time: 0.255143 Apr 14 16:09:13 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 323/970] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:09:13 2023] GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => generated 1497 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:09:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:09:16 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:09:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-a8f939de-e8ac-4620-aee3-cd6ebe7e5f2c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a67642c9-f52d-420f-b5d4-335326ccd403"}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:09:16 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-a8f939de-e8ac-4620-aee3-cd6ebe7e5f2c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:09:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a8f939de-e8ac-4620-aee3-cd6ebe7e5f2c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a8f939de-e8ac-4620-aee3-cd6ebe7e5f2c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a8f939de-e8ac-4620-aee3-cd6ebe7e5f2c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a8f939de-e8ac-4620-aee3-cd6ebe7e5f2c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a8f939de-e8ac-4620-aee3-cd6ebe7e5f2c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:16 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-a8f939de-e8ac-4620-aee3-cd6ebe7e5f2c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:16 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-a8f939de-e8ac-4620-aee3-cd6ebe7e5f2c tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "POST /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.430985 Apr 14 16:09:16 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 326/971] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 16:09:16 2023] POST /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/os-volume_attachments => generated 188 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:09:16 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:09:16 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:09:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-625cf40c-6da3-4814-ba8d-2943d69c7785 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:09:16 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-625cf40c-6da3-4814-ba8d-2943d69c7785 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:09:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-625cf40c-6da3-4814-ba8d-2943d69c7785 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-625cf40c-6da3-4814-ba8d-2943d69c7785 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-625cf40c-6da3-4814-ba8d-2943d69c7785 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-625cf40c-6da3-4814-ba8d-2943d69c7785 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-625cf40c-6da3-4814-ba8d-2943d69c7785 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-625cf40c-6da3-4814-ba8d-2943d69c7785 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:16 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-625cf40c-6da3-4814-ba8d-2943d69c7785 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/os-volume_attachments/a67642c9-f52d-420f-b5d4-335326ccd403" status: 202 len: 0 microversion: 2.20 time: 0.253154 Apr 14 16:09:16 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 323/972] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 16:09:16 2023] DELETE /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/os-volume_attachments/a67642c9-f52d-420f-b5d4-335326ccd403 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:09:17 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:09:17 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:09:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:17 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61875) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 16:09:17 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "POST /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/action" status: 202 len: 0 microversion: 2.20 time: 0.122320 Apr 14 16:09:17 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 324/973] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 16:09:17 2023] POST /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:09:17 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-3b574ddf-b3dc-4246-a6f7-3fbcb5ec266b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:09:17 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-3b574ddf-b3dc-4246-a6f7-3fbcb5ec266b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:09:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3b574ddf-b3dc-4246-a6f7-3fbcb5ec266b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3b574ddf-b3dc-4246-a6f7-3fbcb5ec266b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3b574ddf-b3dc-4246-a6f7-3fbcb5ec266b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3b574ddf-b3dc-4246-a6f7-3fbcb5ec266b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3b574ddf-b3dc-4246-a6f7-3fbcb5ec266b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:17 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3b574ddf-b3dc-4246-a6f7-3fbcb5ec266b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:17 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-3b574ddf-b3dc-4246-a6f7-3fbcb5ec266b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:09:17 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-3b574ddf-b3dc-4246-a6f7-3fbcb5ec266b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:09:17 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-3b574ddf-b3dc-4246-a6f7-3fbcb5ec266b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:09:17 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-3b574ddf-b3dc-4246-a6f7-3fbcb5ec266b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38" status: 200 len: 1661 microversion: 2.20 time: 0.245116 Apr 14 16:09:17 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 327/974] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:09:17 2023] GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 => generated 1661 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:09:19 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89cb156f-a586-4206-b995-999ebca99f38", "tag": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:09:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:19 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] Creating event network-changed:4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance 89cb156f-a586-4206-b995-999ebca99f38 on user Apr 14 16:09:19 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091757 Apr 14 16:09:19 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 324/975] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:09:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:09:25 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-df8511c3-bbac-463b-a56a-323be73c2be8 req-e26a5b81-73d0-464a-ade8-eb17996122aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cb156f-a586-4206-b995-999ebca99f38", "name": "network-vif-plugged", "status": "completed", "tag": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:09:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-df8511c3-bbac-463b-a56a-323be73c2be8 req-e26a5b81-73d0-464a-ade8-eb17996122aa service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-df8511c3-bbac-463b-a56a-323be73c2be8 req-e26a5b81-73d0-464a-ade8-eb17996122aa service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-df8511c3-bbac-463b-a56a-323be73c2be8 req-e26a5b81-73d0-464a-ade8-eb17996122aa service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-df8511c3-bbac-463b-a56a-323be73c2be8 req-e26a5b81-73d0-464a-ade8-eb17996122aa service nova] Creating event network-vif-plugged:4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance 89cb156f-a586-4206-b995-999ebca99f38 on user Apr 14 16:09:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-df8511c3-bbac-463b-a56a-323be73c2be8 req-e26a5b81-73d0-464a-ade8-eb17996122aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041246 Apr 14 16:09:25 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 325/976] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:09:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:09:27 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-61e7f9b9-0c94-45f5-91fd-dcf9048c4bfe req-513853e6-db4f-420b-ae03-17df804684dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cb156f-a586-4206-b995-999ebca99f38", "name": "network-vif-plugged", "status": "completed", "tag": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:09:27 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:09:27 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:09:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-61e7f9b9-0c94-45f5-91fd-dcf9048c4bfe req-513853e6-db4f-420b-ae03-17df804684dc service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-61e7f9b9-0c94-45f5-91fd-dcf9048c4bfe req-513853e6-db4f-420b-ae03-17df804684dc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-61e7f9b9-0c94-45f5-91fd-dcf9048c4bfe req-513853e6-db4f-420b-ae03-17df804684dc service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:27 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-61e7f9b9-0c94-45f5-91fd-dcf9048c4bfe req-513853e6-db4f-420b-ae03-17df804684dc service nova] Creating event network-vif-plugged:4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance 89cb156f-a586-4206-b995-999ebca99f38 on user Apr 14 16:09:27 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-61e7f9b9-0c94-45f5-91fd-dcf9048c4bfe req-513853e6-db4f-420b-ae03-17df804684dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035312 Apr 14 16:09:27 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 328/977] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:09:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-87f132aa-474e-4220-90e1-acd1b2b0ef82 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-87f132aa-474e-4220-90e1-acd1b2b0ef82 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-87f132aa-474e-4220-90e1-acd1b2b0ef82 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-87f132aa-474e-4220-90e1-acd1b2b0ef82 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-87f132aa-474e-4220-90e1-acd1b2b0ef82 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-87f132aa-474e-4220-90e1-acd1b2b0ef82 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-87f132aa-474e-4220-90e1-acd1b2b0ef82 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-87f132aa-474e-4220-90e1-acd1b2b0ef82 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:47 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-87f132aa-474e-4220-90e1-acd1b2b0ef82 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058317 Apr 14 16:09:47 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 325/978] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 16:09:47 2023] GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:09:47 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:09:47 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:09:47 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:09:47 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:09:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:47 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:47 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:09:47 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611" status: 204 len: 0 microversion: 2.1 time: 0.136132 Apr 14 16:09:47 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 326/979] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:09:47 2023] DELETE /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:09:47 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:09:47 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-8bfe0ecf-6ad3-4390-b267-715e1949762f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:09:47 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-8bfe0ecf-6ad3-4390-b267-715e1949762f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:09:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8bfe0ecf-6ad3-4390-b267-715e1949762f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8bfe0ecf-6ad3-4390-b267-715e1949762f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8bfe0ecf-6ad3-4390-b267-715e1949762f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8bfe0ecf-6ad3-4390-b267-715e1949762f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8bfe0ecf-6ad3-4390-b267-715e1949762f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8bfe0ecf-6ad3-4390-b267-715e1949762f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-a4207bb4-0868-4862-bbc5-7cb5dad72427 req-fdf0a8fc-9a5f-4010-b296-b920ce19bebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971c41c2-4757-4a9c-bef7-aff8b6386611", "name": "network-vif-unplugged", "status": "completed", "tag": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a4207bb4-0868-4862-bbc5-7cb5dad72427 req-fdf0a8fc-9a5f-4010-b296-b920ce19bebe service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a4207bb4-0868-4862-bbc5-7cb5dad72427 req-fdf0a8fc-9a5f-4010-b296-b920ce19bebe service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a4207bb4-0868-4862-bbc5-7cb5dad72427 req-fdf0a8fc-9a5f-4010-b296-b920ce19bebe service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:47 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-8bfe0ecf-6ad3-4390-b267-715e1949762f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:09:47 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-a4207bb4-0868-4862-bbc5-7cb5dad72427 req-fdf0a8fc-9a5f-4010-b296-b920ce19bebe service nova] Creating event network-vif-unplugged:36f4a46b-0cb2-4a15-b995-43b84aa8d86a for instance 971c41c2-4757-4a9c-bef7-aff8b6386611 on user Apr 14 16:09:47 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-a4207bb4-0868-4862-bbc5-7cb5dad72427 req-fdf0a8fc-9a5f-4010-b296-b920ce19bebe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032327 Apr 14 16:09:47 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 326/980] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:09:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:09:47 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-8bfe0ecf-6ad3-4390-b267-715e1949762f tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611" status: 200 len: 1670 microversion: 2.1 time: 0.256647 Apr 14 16:09:47 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 329/981] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:09:47 2023] GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611 => generated 1670 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:09:49 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971c41c2-4757-4a9c-bef7-aff8b6386611", "name": "network-vif-plugged", "status": "completed", "tag": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a"}, {"server_uuid": "971c41c2-4757-4a9c-bef7-aff8b6386611", "name": "network-vif-deleted", "tag": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:09:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:09:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:09:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:09:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] Creating event network-vif-plugged:36f4a46b-0cb2-4a15-b995-43b84aa8d86a for instance 971c41c2-4757-4a9c-bef7-aff8b6386611 on user Apr 14 16:09:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] Creating event network-vif-deleted:36f4a46b-0cb2-4a15-b995-43b84aa8d86a for instance 971c41c2-4757-4a9c-bef7-aff8b6386611 on user Apr 14 16:09:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034558 Apr 14 16:09:49 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 327/982] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:09:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:10:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=8 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-e24aa899-b26c-4bcc-b272-d7f1053208d3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:10:07 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-e24aa899-b26c-4bcc-b272-d7f1053208d3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:10:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e24aa899-b26c-4bcc-b272-d7f1053208d3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e24aa899-b26c-4bcc-b272-d7f1053208d3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e24aa899-b26c-4bcc-b272-d7f1053208d3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e24aa899-b26c-4bcc-b272-d7f1053208d3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e24aa899-b26c-4bcc-b272-d7f1053208d3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e24aa899-b26c-4bcc-b272-d7f1053208d3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:07 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-e24aa899-b26c-4bcc-b272-d7f1053208d3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:10:07 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-e24aa899-b26c-4bcc-b272-d7f1053208d3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:10:07 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-e24aa899-b26c-4bcc-b272-d7f1053208d3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:10:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-e24aa899-b26c-4bcc-b272-d7f1053208d3 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38" status: 200 len: 1706 microversion: 2.20 time: 0.282548 Apr 14 16:10:07 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 327/983] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:10:07 2023] GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 => generated 1706 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:10:13 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:10:13 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:10:13 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:13 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:13 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:13 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61876) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 16:10:13 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57/action" status: 202 len: 0 microversion: 2.1 time: 0.187630 Apr 14 16:10:13 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 330/984] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 16:10:13 2023] POST /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:10:13 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:13 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:13 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-08465698-d7d4-487e-af79-c8d74fcbd8ac tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:10:13 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-08465698-d7d4-487e-af79-c8d74fcbd8ac tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:10:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08465698-d7d4-487e-af79-c8d74fcbd8ac tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08465698-d7d4-487e-af79-c8d74fcbd8ac tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08465698-d7d4-487e-af79-c8d74fcbd8ac tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08465698-d7d4-487e-af79-c8d74fcbd8ac tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08465698-d7d4-487e-af79-c8d74fcbd8ac tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:13 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-08465698-d7d4-487e-af79-c8d74fcbd8ac tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:13 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-08465698-d7d4-487e-af79-c8d74fcbd8ac tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca751b25580040a2b48039142c91d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f145f9471aa46ab88e93a9d4c7a4535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:10:13 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-08465698-d7d4-487e-af79-c8d74fcbd8ac tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57" status: 200 len: 1505 microversion: 2.1 time: 0.261185 Apr 14 16:10:13 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 328/985] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:10:13 2023] GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:20 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:10:20 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:20 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] Creating event network-changed:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:10:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055112 Apr 14 16:10:20 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 328/986] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:10:23 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-27c16bad-ddf7-4959-b29a-6684f4d30dbc req-3987a3b5-dfb3-4cf5-bff9-4f482a2bf99f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "name": "network-vif-plugged", "status": "completed", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:10:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-27c16bad-ddf7-4959-b29a-6684f4d30dbc req-3987a3b5-dfb3-4cf5-bff9-4f482a2bf99f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-27c16bad-ddf7-4959-b29a-6684f4d30dbc req-3987a3b5-dfb3-4cf5-bff9-4f482a2bf99f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-27c16bad-ddf7-4959-b29a-6684f4d30dbc req-3987a3b5-dfb3-4cf5-bff9-4f482a2bf99f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-27c16bad-ddf7-4959-b29a-6684f4d30dbc req-3987a3b5-dfb3-4cf5-bff9-4f482a2bf99f service nova] Creating event network-vif-plugged:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:10:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-27c16bad-ddf7-4959-b29a-6684f4d30dbc req-3987a3b5-dfb3-4cf5-bff9-4f482a2bf99f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050607 Apr 14 16:10:23 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 331/987] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:10:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:10:25 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-d6925845-8ed7-430b-b221-67d223c2fcd6 req-800a4c05-2991-4d6e-b9f6-304365f204ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "name": "network-vif-plugged", "status": "completed", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:10:25 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:25 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-d6925845-8ed7-430b-b221-67d223c2fcd6 req-800a4c05-2991-4d6e-b9f6-304365f204ab service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-d6925845-8ed7-430b-b221-67d223c2fcd6 req-800a4c05-2991-4d6e-b9f6-304365f204ab service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-d6925845-8ed7-430b-b221-67d223c2fcd6 req-800a4c05-2991-4d6e-b9f6-304365f204ab service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-d6925845-8ed7-430b-b221-67d223c2fcd6 req-800a4c05-2991-4d6e-b9f6-304365f204ab service nova] Creating event network-vif-plugged:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:10:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-d6925845-8ed7-430b-b221-67d223c2fcd6 req-800a4c05-2991-4d6e-b9f6-304365f204ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034530 Apr 14 16:10:25 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 329/988] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:10:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:10:37 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:37 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:37 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3dbdfcbf-4baa-4eb4-b38a-9d0c1e4799f0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:10:37 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-3dbdfcbf-4baa-4eb4-b38a-9d0c1e4799f0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:10:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3dbdfcbf-4baa-4eb4-b38a-9d0c1e4799f0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3dbdfcbf-4baa-4eb4-b38a-9d0c1e4799f0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3dbdfcbf-4baa-4eb4-b38a-9d0c1e4799f0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3dbdfcbf-4baa-4eb4-b38a-9d0c1e4799f0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3dbdfcbf-4baa-4eb4-b38a-9d0c1e4799f0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:37 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3dbdfcbf-4baa-4eb4-b38a-9d0c1e4799f0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-3dbdfcbf-4baa-4eb4-b38a-9d0c1e4799f0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:10:37 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3dbdfcbf-4baa-4eb4-b38a-9d0c1e4799f0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:10:37 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611 HTTP/1.1 Apr 14 16:10:37 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:10:37 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:10:37 user devstack@n-api.service[61874]: Connection: close Apr 14 16:10:37 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:10:37 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:10:37 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:10:37 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:10:37 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:10:37 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:10:37 user devstack@n-api.service[61874]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:10:37 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:10:37 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:10:37 user devstack@n-api.service[61874]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:10:37 user devstack@n-api.service[61874]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:10:37 user devstack@n-api.service[61874]: method: > Apr 14 16:10:37 user devstack@n-api.service[61874]: exception: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:10:37 user devstack@n-api.service[61874]: action_args: {'id': '971c41c2-4757-4a9c-bef7-aff8b6386611'} Apr 14 16:10:37 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:10:37 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:10:37 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3dbdfcbf-4baa-4eb4-b38a-9d0c1e4799f0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 404 to user: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:10:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-3dbdfcbf-4baa-4eb4-b38a-9d0c1e4799f0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611" status: 404 len: 111 microversion: 2.1 time: 0.040159 Apr 14 16:10:37 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 329/989] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:10:37 2023] GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:10:37 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:37 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:37 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-3c86b136-534f-46cd-a0ca-865be79fa1e5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '.version_select at 0x7f2970943010>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:10:37 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-3c86b136-534f-46cd-a0ca-865be79fa1e5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-388847104" status: 202 len: 0 microversion: 2.1 time: 0.041689 Apr 14 16:10:37 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 332/990] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 16:10:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-388847104 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:10:38 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:38 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:10:38 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f461846d-4383-44ff-916b-04730a0f3ff3 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Action: 'create', calling method: .version_select at 0x7f2970a476d0>, body: {"keypair": {"name": "tempest-keypair-2020858187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMies72o3CTJZcRAOo1f/8fx+L36gTla/KTevmmTBxnCOJ4l2fhCY8Lh+4u86skeMnTKY3SGVCASxcYOcS2vN2SDP9c5xB/Mx9DXTuFAMVvifMjJD8BK8/dZ0BuqCqyVpw=="}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:10:38 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-f461846d-4383-44ff-916b-04730a0f3ff3 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for project ecb4d204dbf24c19b978456d16d19e87. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:10:38 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-f461846d-4383-44ff-916b-04730a0f3ff3 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for user 2d83796cd8d5464fa4e580844441da81 and project ecb4d204dbf24c19b978456d16d19e87. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:10:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-f461846d-4383-44ff-916b-04730a0f3ff3 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055909 Apr 14 16:10:38 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 330/991] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 16:10:38 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2085721900", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "5deec755-9819-4003-820a-2b9360f5dc62"}], "security_groups": [{"name": "tempest-securitygroup--1040589689"}], "key_name": "tempest-keypair-2020858187", "user_data": "}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] validate_networks() for [('5deec755-9819-4003-820a-2b9360f5dc62', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for project ecb4d204dbf24c19b978456d16d19e87. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting quotas for user 2d83796cd8d5464fa4e580844441da81 and project ecb4d204dbf24c19b978456d16d19e87. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:10:40 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:10:40 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.689642 Apr 14 16:10:40 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 330/992] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:10:40 2023] POST /compute/v2.1/servers => generated 400 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:10:40 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-0c5fba6c-8d5e-417f-b1ea-ce9dad3cd7aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:10:40 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-0c5fba6c-8d5e-417f-b1ea-ce9dad3cd7aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:10:40 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-0c5fba6c-8d5e-417f-b1ea-ce9dad3cd7aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:10:40 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-0c5fba6c-8d5e-417f-b1ea-ce9dad3cd7aa tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258" status: 200 len: 1236 microversion: 2.1 time: 0.069886 Apr 14 16:10:40 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 333/993] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:10:40 2023] GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258 => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:10:43 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1963f30-fea7-49f0-aa6d-5df33a362258", "tag": "a088891b-f698-4783-8b4d-caacf03d3747"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:10:43 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:43 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:43 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:43 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] Creating event network-changed:a088891b-f698-4783-8b4d-caacf03d3747 for instance f1963f30-fea7-49f0-aa6d-5df33a362258 on user Apr 14 16:10:43 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030277 Apr 14 16:10:43 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 331/994] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:10:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:10:45 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-6048f4e9-c543-4524-850e-1cc302c54f7b req-5fd021ee-4112-4027-bce6-cdbad7f5656a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1963f30-fea7-49f0-aa6d-5df33a362258", "name": "network-vif-plugged", "status": "completed", "tag": "a088891b-f698-4783-8b4d-caacf03d3747"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:10:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6048f4e9-c543-4524-850e-1cc302c54f7b req-5fd021ee-4112-4027-bce6-cdbad7f5656a service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6048f4e9-c543-4524-850e-1cc302c54f7b req-5fd021ee-4112-4027-bce6-cdbad7f5656a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-6048f4e9-c543-4524-850e-1cc302c54f7b req-5fd021ee-4112-4027-bce6-cdbad7f5656a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:45 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-6048f4e9-c543-4524-850e-1cc302c54f7b req-5fd021ee-4112-4027-bce6-cdbad7f5656a service nova] Creating event network-vif-plugged:a088891b-f698-4783-8b4d-caacf03d3747 for instance f1963f30-fea7-49f0-aa6d-5df33a362258 on user Apr 14 16:10:45 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-6048f4e9-c543-4524-850e-1cc302c54f7b req-5fd021ee-4112-4027-bce6-cdbad7f5656a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046745 Apr 14 16:10:45 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 331/995] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:10:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:10:47 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-9cc025d1-b7d8-4097-be6c-ae596391a813 req-d16d5bcf-873c-4c42-a7ed-cbf7ef322b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1963f30-fea7-49f0-aa6d-5df33a362258", "name": "network-vif-plugged", "status": "completed", "tag": "a088891b-f698-4783-8b4d-caacf03d3747"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:10:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9cc025d1-b7d8-4097-be6c-ae596391a813 req-d16d5bcf-873c-4c42-a7ed-cbf7ef322b87 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:10:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9cc025d1-b7d8-4097-be6c-ae596391a813 req-d16d5bcf-873c-4c42-a7ed-cbf7ef322b87 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:10:47 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9cc025d1-b7d8-4097-be6c-ae596391a813 req-d16d5bcf-873c-4c42-a7ed-cbf7ef322b87 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:10:47 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-9cc025d1-b7d8-4097-be6c-ae596391a813 req-d16d5bcf-873c-4c42-a7ed-cbf7ef322b87 service nova] Creating event network-vif-plugged:a088891b-f698-4783-8b4d-caacf03d3747 for instance f1963f30-fea7-49f0-aa6d-5df33a362258 on user Apr 14 16:10:47 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-9cc025d1-b7d8-4097-be6c-ae596391a813 req-d16d5bcf-873c-4c42-a7ed-cbf7ef322b87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032901 Apr 14 16:10:47 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 334/996] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:10:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:03 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a99ea2be-2357-4737-9ac7-a12a1b9b6e4e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:11:03 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a99ea2be-2357-4737-9ac7-a12a1b9b6e4e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:11:03 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:03 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:03 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a99ea2be-2357-4737-9ac7-a12a1b9b6e4e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a99ea2be-2357-4737-9ac7-a12a1b9b6e4e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a99ea2be-2357-4737-9ac7-a12a1b9b6e4e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a99ea2be-2357-4737-9ac7-a12a1b9b6e4e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a99ea2be-2357-4737-9ac7-a12a1b9b6e4e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:03 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a99ea2be-2357-4737-9ac7-a12a1b9b6e4e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:04 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-a99ea2be-2357-4737-9ac7-a12a1b9b6e4e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca751b25580040a2b48039142c91d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f145f9471aa46ab88e93a9d4c7a4535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:11:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a99ea2be-2357-4737-9ac7-a12a1b9b6e4e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57" status: 200 len: 1550 microversion: 2.1 time: 0.239883 Apr 14 16:11:04 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 332/997] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:11:03 2023] GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => generated 1550 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-40c0e7e1-88f0-463e-84cb-379f222436a5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:11:07 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-40c0e7e1-88f0-463e-84cb-379f222436a5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:11:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-40c0e7e1-88f0-463e-84cb-379f222436a5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-40c0e7e1-88f0-463e-84cb-379f222436a5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-40c0e7e1-88f0-463e-84cb-379f222436a5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-40c0e7e1-88f0-463e-84cb-379f222436a5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-40c0e7e1-88f0-463e-84cb-379f222436a5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-40c0e7e1-88f0-463e-84cb-379f222436a5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:08 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-40c0e7e1-88f0-463e-84cb-379f222436a5 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055953 Apr 14 16:11:08 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 332/998] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 16:11:07 2023] GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:11:08 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:11:08 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:08 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:08 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:08 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Going to try to terminate instance {{(pid=61876) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:11:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38" status: 204 len: 0 microversion: 2.20 time: 0.144368 Apr 14 16:11:08 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 335/999] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 16:11:08 2023] DELETE /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 16:11:08 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f2f8e914-0761-434f-99af-5bb680196328 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:11:08 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-f2f8e914-0761-434f-99af-5bb680196328 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:11:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f2f8e914-0761-434f-99af-5bb680196328 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f2f8e914-0761-434f-99af-5bb680196328 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f2f8e914-0761-434f-99af-5bb680196328 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f2f8e914-0761-434f-99af-5bb680196328 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f2f8e914-0761-434f-99af-5bb680196328 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:08 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f2f8e914-0761-434f-99af-5bb680196328 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:08 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-f2f8e914-0761-434f-99af-5bb680196328 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:11:08 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-f2f8e914-0761-434f-99af-5bb680196328 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:11:08 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-f2f8e914-0761-434f-99af-5bb680196328 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:11:08 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-f2f8e914-0761-434f-99af-5bb680196328 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38" status: 200 len: 1712 microversion: 2.20 time: 0.258566 Apr 14 16:11:08 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 333/1000] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:11:08 2023] GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 => generated 1712 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:11:08 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-58da2aa5-9013-48bc-ba9d-b378f5b4f570 req-5897ac09-a538-4e39-8991-a199a08b19e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cb156f-a586-4206-b995-999ebca99f38", "name": "network-vif-unplugged", "status": "completed", "tag": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-58da2aa5-9013-48bc-ba9d-b378f5b4f570 req-5897ac09-a538-4e39-8991-a199a08b19e3 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-58da2aa5-9013-48bc-ba9d-b378f5b4f570 req-5897ac09-a538-4e39-8991-a199a08b19e3 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:08 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-58da2aa5-9013-48bc-ba9d-b378f5b4f570 req-5897ac09-a538-4e39-8991-a199a08b19e3 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:08 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-58da2aa5-9013-48bc-ba9d-b378f5b4f570 req-5897ac09-a538-4e39-8991-a199a08b19e3 service nova] Creating event network-vif-unplugged:4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance 89cb156f-a586-4206-b995-999ebca99f38 on user Apr 14 16:11:08 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-58da2aa5-9013-48bc-ba9d-b378f5b4f570 req-5897ac09-a538-4e39-8991-a199a08b19e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028211 Apr 14 16:11:08 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 333/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:11:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:10 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cb156f-a586-4206-b995-999ebca99f38", "name": "network-vif-plugged", "status": "completed", "tag": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38"}, {"server_uuid": "89cb156f-a586-4206-b995-999ebca99f38", "name": "network-vif-deleted", "tag": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:11:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] Creating event network-vif-plugged:4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance 89cb156f-a586-4206-b995-999ebca99f38 on user Apr 14 16:11:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] Creating event network-vif-deleted:4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance 89cb156f-a586-4206-b995-999ebca99f38 on user Apr 14 16:11:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031401 Apr 14 16:11:10 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 336/1002] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:11:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:11:31 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:31 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=12 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:31 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-50ec493a-cf8c-4141-a58e-0f057896999d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:11:31 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-50ec493a-cf8c-4141-a58e-0f057896999d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:11:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-50ec493a-cf8c-4141-a58e-0f057896999d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-50ec493a-cf8c-4141-a58e-0f057896999d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-50ec493a-cf8c-4141-a58e-0f057896999d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-50ec493a-cf8c-4141-a58e-0f057896999d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-50ec493a-cf8c-4141-a58e-0f057896999d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-50ec493a-cf8c-4141-a58e-0f057896999d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:31 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-50ec493a-cf8c-4141-a58e-0f057896999d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:11:31 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-50ec493a-cf8c-4141-a58e-0f057896999d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258" status: 200 len: 1546 microversion: 2.1 time: 0.274595 Apr 14 16:11:31 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 334/1003] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:11:31 2023] GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258 => generated 1546 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:11:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-508afb98-31f1-4f2a-8688-2beb3c7bda26 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:11:58 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-508afb98-31f1-4f2a-8688-2beb3c7bda26 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:11:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:58 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=8 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-508afb98-31f1-4f2a-8688-2beb3c7bda26 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-508afb98-31f1-4f2a-8688-2beb3c7bda26 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-508afb98-31f1-4f2a-8688-2beb3c7bda26 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-508afb98-31f1-4f2a-8688-2beb3c7bda26 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:11:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-508afb98-31f1-4f2a-8688-2beb3c7bda26 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:11:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-508afb98-31f1-4f2a-8688-2beb3c7bda26 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:11:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-508afb98-31f1-4f2a-8688-2beb3c7bda26 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] HTTP exception thrown: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:11:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-508afb98-31f1-4f2a-8688-2beb3c7bda26 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Request method failure captured: Apr 14 16:11:58 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 HTTP/1.1 Apr 14 16:11:58 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:11:58 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:11:58 user devstack@n-api.service[61874]: Connection: close Apr 14 16:11:58 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:11:58 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:11:58 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:11:58 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:11:58 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXgNEVA_utxKv7mi1WYJGZur2b31jANkV6VuQB4jdLQmaIQWOAofjq3jeuIFO1xh7pkyLY7hTEqZAVH26QUOyMPoPmNOGIaq0WB2Ka2i2jxM7cTslU6i_GEzXZzsrTJ-bekg5SFWnJQOvJ0Xo_A8y4TLs4dXbwmA2yzxJU0eQs4ZFa8 Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Project-Id: b0dd8e5513a94cc8b22c291bac3b066f Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Tenant-Id: b0dd8e5513a94cc8b22c291bac3b066f Apr 14 16:11:58 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:11:58 user devstack@n-api.service[61874]: X-User: tempest-AttachVolumeShelveTestJSON-1653640190-project-member Apr 14 16:11:58 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:11:58 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:11:58 user devstack@n-api.service[61874]: X-User-Id: 194adad706f94ef89a86fbcb9d8888ac Apr 14 16:11:58 user devstack@n-api.service[61874]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1653640190-project-member Apr 14 16:11:58 user devstack@n-api.service[61874]: method: > Apr 14 16:11:58 user devstack@n-api.service[61874]: exception: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:11:58 user devstack@n-api.service[61874]: action_args: {'id': '89cb156f-a586-4206-b995-999ebca99f38'} Apr 14 16:11:58 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:11:58 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:11:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-508afb98-31f1-4f2a-8688-2beb3c7bda26 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Returning 404 to user: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:11:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-508afb98-31f1-4f2a-8688-2beb3c7bda26 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38" status: 404 len: 111 microversion: 2.20 time: 0.039025 Apr 14 16:11:58 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 334/1004] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:11:58 2023] GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:11:58 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-cd0d9757-603f-41c7-90d1-b6ce37531a24 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '.version_select at 0x7f2970864af0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:11:58 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:58 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:11:58 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-cd0d9757-603f-41c7-90d1-b6ce37531a24 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-564331105" status: 204 len: 0 microversion: 2.20 time: 0.031293 Apr 14 16:11:58 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 337/1005] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 16:11:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-564331105 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 16:12:02 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-9d9ccd04-3921-410d-969a-5ff9c1315d31 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:12:02 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-9d9ccd04-3921-410d-969a-5ff9c1315d31 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:12:02 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:02 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9d9ccd04-3921-410d-969a-5ff9c1315d31 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9d9ccd04-3921-410d-969a-5ff9c1315d31 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9d9ccd04-3921-410d-969a-5ff9c1315d31 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9d9ccd04-3921-410d-969a-5ff9c1315d31 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9d9ccd04-3921-410d-969a-5ff9c1315d31 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9d9ccd04-3921-410d-969a-5ff9c1315d31 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-9d9ccd04-3921-410d-969a-5ff9c1315d31 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] HTTP exception thrown: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:12:02 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-9d9ccd04-3921-410d-969a-5ff9c1315d31 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Request method failure captured: Apr 14 16:12:02 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 HTTP/1.1 Apr 14 16:12:02 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:12:02 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:12:02 user devstack@n-api.service[61875]: Connection: close Apr 14 16:12:02 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:12:02 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:12:02 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:12:02 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:12:02 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXgNEVA_utxKv7mi1WYJGZur2b31jANkV6VuQB4jdLQmaIQWOAofjq3jeuIFO1xh7pkyLY7hTEqZAVH26QUOyMPoPmNOGIaq0WB2Ka2i2jxM7cTslU6i_GEzXZzsrTJ-bekg5SFWnJQOvJ0Xo_A8y4TLs4dXbwmA2yzxJU0eQs4ZFa8 Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Project-Id: b0dd8e5513a94cc8b22c291bac3b066f Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Tenant-Id: b0dd8e5513a94cc8b22c291bac3b066f Apr 14 16:12:02 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:12:02 user devstack@n-api.service[61875]: X-User: tempest-AttachVolumeShelveTestJSON-1653640190-project-member Apr 14 16:12:02 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:12:02 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:12:02 user devstack@n-api.service[61875]: X-User-Id: 194adad706f94ef89a86fbcb9d8888ac Apr 14 16:12:02 user devstack@n-api.service[61875]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1653640190-project-member Apr 14 16:12:02 user devstack@n-api.service[61875]: method: > Apr 14 16:12:02 user devstack@n-api.service[61875]: exception: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:12:02 user devstack@n-api.service[61875]: action_args: {'id': '89cb156f-a586-4206-b995-999ebca99f38'} Apr 14 16:12:02 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:12:02 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:02 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-9d9ccd04-3921-410d-969a-5ff9c1315d31 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Returning 404 to user: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:12:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-9d9ccd04-3921-410d-969a-5ff9c1315d31 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38" status: 404 len: 111 microversion: 2.20 time: 0.038633 Apr 14 16:12:02 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 335/1006] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 16:12:02 2023] DELETE /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:12:02 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-5f4978bd-984c-4c3e-a871-462bcca6c7d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:12:02 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-5f4978bd-984c-4c3e-a871-462bcca6c7d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:12:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5f4978bd-984c-4c3e-a871-462bcca6c7d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5f4978bd-984c-4c3e-a871-462bcca6c7d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5f4978bd-984c-4c3e-a871-462bcca6c7d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5f4978bd-984c-4c3e-a871-462bcca6c7d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5f4978bd-984c-4c3e-a871-462bcca6c7d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5f4978bd-984c-4c3e-a871-462bcca6c7d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:02 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-5f4978bd-984c-4c3e-a871-462bcca6c7d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] HTTP exception thrown: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:12:02 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-5f4978bd-984c-4c3e-a871-462bcca6c7d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Request method failure captured: Apr 14 16:12:02 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 HTTP/1.1 Apr 14 16:12:02 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:12:02 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:12:02 user devstack@n-api.service[61874]: Connection: close Apr 14 16:12:02 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:12:02 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:12:02 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:12:02 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:12:02 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXgNEVA_utxKv7mi1WYJGZur2b31jANkV6VuQB4jdLQmaIQWOAofjq3jeuIFO1xh7pkyLY7hTEqZAVH26QUOyMPoPmNOGIaq0WB2Ka2i2jxM7cTslU6i_GEzXZzsrTJ-bekg5SFWnJQOvJ0Xo_A8y4TLs4dXbwmA2yzxJU0eQs4ZFa8 Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Project-Id: b0dd8e5513a94cc8b22c291bac3b066f Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Tenant-Id: b0dd8e5513a94cc8b22c291bac3b066f Apr 14 16:12:02 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:12:02 user devstack@n-api.service[61874]: X-User: tempest-AttachVolumeShelveTestJSON-1653640190-project-member Apr 14 16:12:02 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:12:02 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:12:02 user devstack@n-api.service[61874]: X-User-Id: 194adad706f94ef89a86fbcb9d8888ac Apr 14 16:12:02 user devstack@n-api.service[61874]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1653640190-project-member Apr 14 16:12:02 user devstack@n-api.service[61874]: method: > Apr 14 16:12:02 user devstack@n-api.service[61874]: exception: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:12:02 user devstack@n-api.service[61874]: action_args: {'id': '89cb156f-a586-4206-b995-999ebca99f38'} Apr 14 16:12:02 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. Apr 14 16:12:02 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:12:02 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-5f4978bd-984c-4c3e-a871-462bcca6c7d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Returning 404 to user: Instance 89cb156f-a586-4206-b995-999ebca99f38 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:12:02 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-5f4978bd-984c-4c3e-a871-462bcca6c7d2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38" status: 404 len: 111 microversion: 2.20 time: 0.032359 Apr 14 16:12:02 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 335/1007] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:12:02 2023] GET /compute/v2.1/servers/89cb156f-a586-4206-b995-999ebca99f38 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:12:05 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:12:05 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:12:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:05 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Going to try to terminate instance {{(pid=61876) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:12:05 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:05 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:05 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] Creating event network-changed:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:12:05 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096894 Apr 14 16:12:05 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 336/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:12:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:05 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57" status: 204 len: 0 microversion: 2.1 time: 0.114553 Apr 14 16:12:05 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 338/1009] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:12:05 2023] DELETE /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:12:05 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-5364e639-1f9f-49dc-8755-08c955df249e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:12:05 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-5364e639-1f9f-49dc-8755-08c955df249e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:12:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5364e639-1f9f-49dc-8755-08c955df249e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5364e639-1f9f-49dc-8755-08c955df249e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5364e639-1f9f-49dc-8755-08c955df249e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5364e639-1f9f-49dc-8755-08c955df249e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5364e639-1f9f-49dc-8755-08c955df249e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:05 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-5364e639-1f9f-49dc-8755-08c955df249e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:05 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-5364e639-1f9f-49dc-8755-08c955df249e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca751b25580040a2b48039142c91d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f145f9471aa46ab88e93a9d4c7a4535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:12:05 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-5364e639-1f9f-49dc-8755-08c955df249e tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57" status: 200 len: 1556 microversion: 2.1 time: 0.346075 Apr 14 16:12:05 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 336/1010] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:12:05 2023] GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => generated 1556 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:12:06 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-66f35139-a044-4aa4-8e75-83d0f8b8cccc tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:12:06 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-66f35139-a044-4aa4-8e75-83d0f8b8cccc tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:12:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-66f35139-a044-4aa4-8e75-83d0f8b8cccc tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-66f35139-a044-4aa4-8e75-83d0f8b8cccc tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-66f35139-a044-4aa4-8e75-83d0f8b8cccc tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-66f35139-a044-4aa4-8e75-83d0f8b8cccc tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-66f35139-a044-4aa4-8e75-83d0f8b8cccc tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-66f35139-a044-4aa4-8e75-83d0f8b8cccc tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:06 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-66f35139-a044-4aa4-8e75-83d0f8b8cccc tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] HTTP exception thrown: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:12:06 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-66f35139-a044-4aa4-8e75-83d0f8b8cccc tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Request method failure captured: Apr 14 16:12:06 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 HTTP/1.1 Apr 14 16:12:06 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:12:06 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:12:06 user devstack@n-api.service[61875]: Connection: close Apr 14 16:12:06 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:12:06 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:12:06 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:12:06 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:12:06 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXgNEVA_utxKv7mi1WYJGZur2b31jANkV6VuQB4jdLQmaIQWOAofjq3jeuIFO1xh7pkyLY7hTEqZAVH26QUOyMPoPmNOGIaq0WB2Ka2i2jxM7cTslU6i_GEzXZzsrTJ-bekg5SFWnJQOvJ0Xo_A8y4TLs4dXbwmA2yzxJU0eQs4ZFa8 Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Project-Id: b0dd8e5513a94cc8b22c291bac3b066f Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Tenant-Id: b0dd8e5513a94cc8b22c291bac3b066f Apr 14 16:12:06 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:12:06 user devstack@n-api.service[61875]: X-User: tempest-AttachVolumeShelveTestJSON-1653640190-project-member Apr 14 16:12:06 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:12:06 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:12:06 user devstack@n-api.service[61875]: X-User-Id: 194adad706f94ef89a86fbcb9d8888ac Apr 14 16:12:06 user devstack@n-api.service[61875]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1653640190-project-member Apr 14 16:12:06 user devstack@n-api.service[61875]: method: > Apr 14 16:12:06 user devstack@n-api.service[61875]: exception: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:12:06 user devstack@n-api.service[61875]: action_args: {'id': '8ebde9c7-b620-4553-856c-c6a3429381b6'} Apr 14 16:12:06 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:12:06 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:06 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-66f35139-a044-4aa4-8e75-83d0f8b8cccc tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Returning 404 to user: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:12:06 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-66f35139-a044-4aa4-8e75-83d0f8b8cccc tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6" status: 404 len: 111 microversion: 2.20 time: 0.030753 Apr 14 16:12:06 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 337/1011] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 16:12:06 2023] DELETE /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:12:06 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-8c2ec9f8-cfd3-4833-8e94-044f4d6a59c2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:12:06 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-8c2ec9f8-cfd3-4833-8e94-044f4d6a59c2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:12:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8c2ec9f8-cfd3-4833-8e94-044f4d6a59c2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8c2ec9f8-cfd3-4833-8e94-044f4d6a59c2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8c2ec9f8-cfd3-4833-8e94-044f4d6a59c2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8c2ec9f8-cfd3-4833-8e94-044f4d6a59c2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8c2ec9f8-cfd3-4833-8e94-044f4d6a59c2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:06 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8c2ec9f8-cfd3-4833-8e94-044f4d6a59c2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:06 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-8c2ec9f8-cfd3-4833-8e94-044f4d6a59c2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] HTTP exception thrown: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:12:06 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-8c2ec9f8-cfd3-4833-8e94-044f4d6a59c2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Request method failure captured: Apr 14 16:12:06 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 HTTP/1.1 Apr 14 16:12:06 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:12:06 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:12:06 user devstack@n-api.service[61876]: Connection: close Apr 14 16:12:06 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:12:06 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:12:06 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:12:06 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:12:06 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXgNEVA_utxKv7mi1WYJGZur2b31jANkV6VuQB4jdLQmaIQWOAofjq3jeuIFO1xh7pkyLY7hTEqZAVH26QUOyMPoPmNOGIaq0WB2Ka2i2jxM7cTslU6i_GEzXZzsrTJ-bekg5SFWnJQOvJ0Xo_A8y4TLs4dXbwmA2yzxJU0eQs4ZFa8 Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Project-Id: b0dd8e5513a94cc8b22c291bac3b066f Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0dd8e5513a94cc8b22c291bac3b066f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Tenant-Id: b0dd8e5513a94cc8b22c291bac3b066f Apr 14 16:12:06 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1653640190 Apr 14 16:12:06 user devstack@n-api.service[61876]: X-User: tempest-AttachVolumeShelveTestJSON-1653640190-project-member Apr 14 16:12:06 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:12:06 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:12:06 user devstack@n-api.service[61876]: X-User-Id: 194adad706f94ef89a86fbcb9d8888ac Apr 14 16:12:06 user devstack@n-api.service[61876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1653640190-project-member Apr 14 16:12:06 user devstack@n-api.service[61876]: method: > Apr 14 16:12:06 user devstack@n-api.service[61876]: exception: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:12:06 user devstack@n-api.service[61876]: action_args: {'id': '8ebde9c7-b620-4553-856c-c6a3429381b6'} Apr 14 16:12:06 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. Apr 14 16:12:06 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:12:06 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-8c2ec9f8-cfd3-4833-8e94-044f4d6a59c2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Returning 404 to user: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:12:06 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-8c2ec9f8-cfd3-4833-8e94-044f4d6a59c2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6" status: 404 len: 111 microversion: 2.20 time: 0.034420 Apr 14 16:12:06 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 339/1012] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 16:12:06 2023] GET /compute/v2.1/servers/8ebde9c7-b620-4553-856c-c6a3429381b6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 16:12:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-a1b473ab-935c-418e-b02c-ec3eda668c67 req-e8d79029-1d3b-4793-ad7d-2050457fc12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "name": "network-vif-deleted", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a1b473ab-935c-418e-b02c-ec3eda668c67 req-e8d79029-1d3b-4793-ad7d-2050457fc12c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a1b473ab-935c-418e-b02c-ec3eda668c67 req-e8d79029-1d3b-4793-ad7d-2050457fc12c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a1b473ab-935c-418e-b02c-ec3eda668c67 req-e8d79029-1d3b-4793-ad7d-2050457fc12c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-a1b473ab-935c-418e-b02c-ec3eda668c67 req-e8d79029-1d3b-4793-ad7d-2050457fc12c service nova] Creating event network-vif-deleted:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:12:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-a1b473ab-935c-418e-b02c-ec3eda668c67 req-e8d79029-1d3b-4793-ad7d-2050457fc12c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037206 Apr 14 16:12:07 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 337/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:12:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:07 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "name": "network-vif-unplugged", "status": "completed", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}, {"server_uuid": "8fbd3667-302e-4f1f-8e58-2bdabe5efe57", "name": "network-vif-plugged", "status": "completed", "tag": "f572c852-fb5c-4ceb-aac4-4be593331f83"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:07 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] Creating event network-vif-unplugged:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:12:07 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] Creating event network-vif-plugged:f572c852-fb5c-4ceb-aac4-4be593331f83 for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 on user Apr 14 16:12:07 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037184 Apr 14 16:12:07 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 338/1014] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:12:07 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:22 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-340591422", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34"}]}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:22 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:22 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:22 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] validate_networks() for [('69b009a5-c526-4ef9-9ba2-ad9c03e24e34', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Getting quotas for project 15fb9ccf20ec4ef2a6b64004df0061e4. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Getting quotas for user 6061fcff5317445cab3a8da6f24d9ba4 and project 15fb9ccf20ec4ef2a6b64004df0061e4. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:12:23 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:12:23 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.652384 Apr 14 16:12:23 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 340/1015] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:12:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:12:23 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=8 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:23 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=12 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:23 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-63f00a55-0bb5-425e-8636-0e56a209bebe tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:12:23 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-63f00a55-0bb5-425e-8636-0e56a209bebe tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:12:23 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-63f00a55-0bb5-425e-8636-0e56a209bebe tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6061fcff5317445cab3a8da6f24d9ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fb9ccf20ec4ef2a6b64004df0061e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:12:23 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-63f00a55-0bb5-425e-8636-0e56a209bebe tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5355a43-4e93-484e-87ad-6e179c8821c2" status: 200 len: 1207 microversion: 2.1 time: 0.096713 Apr 14 16:12:23 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 338/1016] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:12:23 2023] GET /compute/v2.1/servers/f5355a43-4e93-484e-87ad-6e179c8821c2 => generated 1207 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 16:12:25 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=8 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:25 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=8 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:25 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5355a43-4e93-484e-87ad-6e179c8821c2", "tag": "fd90e988-80fd-4292-af7a-719a534d38db"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:25 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] Creating event network-changed:fd90e988-80fd-4292-af7a-719a534d38db for instance f5355a43-4e93-484e-87ad-6e179c8821c2 on user Apr 14 16:12:25 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037697 Apr 14 16:12:25 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 339/1017] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:12:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:27 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-b2ef1697-f580-47e8-83f4-aeef84ac58a1 req-dc5fcc9c-01c9-4777-ac5a-0267e2493e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5355a43-4e93-484e-87ad-6e179c8821c2", "name": "network-vif-plugged", "status": "completed", "tag": "fd90e988-80fd-4292-af7a-719a534d38db"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b2ef1697-f580-47e8-83f4-aeef84ac58a1 req-dc5fcc9c-01c9-4777-ac5a-0267e2493e54 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b2ef1697-f580-47e8-83f4-aeef84ac58a1 req-dc5fcc9c-01c9-4777-ac5a-0267e2493e54 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:27 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b2ef1697-f580-47e8-83f4-aeef84ac58a1 req-dc5fcc9c-01c9-4777-ac5a-0267e2493e54 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:27 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-b2ef1697-f580-47e8-83f4-aeef84ac58a1 req-dc5fcc9c-01c9-4777-ac5a-0267e2493e54 service nova] Creating event network-vif-plugged:fd90e988-80fd-4292-af7a-719a534d38db for instance f5355a43-4e93-484e-87ad-6e179c8821c2 on user Apr 14 16:12:27 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-b2ef1697-f580-47e8-83f4-aeef84ac58a1 req-dc5fcc9c-01c9-4777-ac5a-0267e2493e54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151448 Apr 14 16:12:27 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 341/1018] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:12:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:29 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-76d0b6e5-59dd-423b-96ea-2e8d24ea6737 req-8002bd9e-b434-4ad9-abf4-61c6d2c9564a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5355a43-4e93-484e-87ad-6e179c8821c2", "name": "network-vif-plugged", "status": "completed", "tag": "fd90e988-80fd-4292-af7a-719a534d38db"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:29 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-76d0b6e5-59dd-423b-96ea-2e8d24ea6737 req-8002bd9e-b434-4ad9-abf4-61c6d2c9564a service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:29 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-76d0b6e5-59dd-423b-96ea-2e8d24ea6737 req-8002bd9e-b434-4ad9-abf4-61c6d2c9564a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:29 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-76d0b6e5-59dd-423b-96ea-2e8d24ea6737 req-8002bd9e-b434-4ad9-abf4-61c6d2c9564a service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:29 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-76d0b6e5-59dd-423b-96ea-2e8d24ea6737 req-8002bd9e-b434-4ad9-abf4-61c6d2c9564a service nova] Creating event network-vif-plugged:fd90e988-80fd-4292-af7a-719a534d38db for instance f5355a43-4e93-484e-87ad-6e179c8821c2 on user Apr 14 16:12:29 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-76d0b6e5-59dd-423b-96ea-2e8d24ea6737 req-8002bd9e-b434-4ad9-abf4-61c6d2c9564a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040056 Apr 14 16:12:29 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 339/1019] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:12:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:31 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-e510c55f-c1b5-4a6b-abb5-ae8e19c571e2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:12:31 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-e510c55f-c1b5-4a6b-abb5-ae8e19c571e2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:12:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e510c55f-c1b5-4a6b-abb5-ae8e19c571e2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e510c55f-c1b5-4a6b-abb5-ae8e19c571e2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e510c55f-c1b5-4a6b-abb5-ae8e19c571e2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e510c55f-c1b5-4a6b-abb5-ae8e19c571e2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e510c55f-c1b5-4a6b-abb5-ae8e19c571e2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e510c55f-c1b5-4a6b-abb5-ae8e19c571e2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:31 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-e510c55f-c1b5-4a6b-abb5-ae8e19c571e2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.163105 Apr 14 16:12:31 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 340/1020] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 16:12:31 2023] GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258/os-interface => generated 282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:32 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1963f30-fea7-49f0-aa6d-5df33a362258", "tag": "a088891b-f698-4783-8b4d-caacf03d3747"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:32 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] Creating event network-changed:a088891b-f698-4783-8b4d-caacf03d3747 for instance f1963f30-fea7-49f0-aa6d-5df33a362258 on user Apr 14 16:12:32 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037761 Apr 14 16:12:32 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 342/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:12:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:32 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-be05c94b-792c-4502-9a31-dee3c45f9d88 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:12:32 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-be05c94b-792c-4502-9a31-dee3c45f9d88 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:12:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-be05c94b-792c-4502-9a31-dee3c45f9d88 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-be05c94b-792c-4502-9a31-dee3c45f9d88 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-be05c94b-792c-4502-9a31-dee3c45f9d88 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-be05c94b-792c-4502-9a31-dee3c45f9d88 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-be05c94b-792c-4502-9a31-dee3c45f9d88 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-be05c94b-792c-4502-9a31-dee3c45f9d88 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:32 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-be05c94b-792c-4502-9a31-dee3c45f9d88 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258/ips" status: 200 len: 108 microversion: 2.1 time: 0.048550 Apr 14 16:12:32 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 340/1022] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 16:12:32 2023] GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258/ips => generated 108 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:34 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fe10619-864c-47ef-85f3-184510e76ebd"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:12:34 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:12:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370876 Apr 14 16:12:35 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 341/1023] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 16:12:34 2023] POST /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:43 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:43 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:43 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:43 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:43 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:12:43 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:12:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:43 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:43 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'services' on Instance uuid f1963f30-fea7-49f0-aa6d-5df33a362258 {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 16:12:43 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258/os-volume_attachments/3fe10619-864c-47ef-85f3-184510e76ebd" status: 202 len: 0 microversion: 2.1 time: 0.223515 Apr 14 16:12:43 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 343/1024] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 16:12:43 2023] DELETE /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258/os-volume_attachments/3fe10619-864c-47ef-85f3-184510e76ebd => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:12:43 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:43 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=8 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:43 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:43 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-07370334-d6e4-4022-8f38-8974f49ca465 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:12:43 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-07370334-d6e4-4022-8f38-8974f49ca465 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:12:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-07370334-d6e4-4022-8f38-8974f49ca465 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-07370334-d6e4-4022-8f38-8974f49ca465 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-07370334-d6e4-4022-8f38-8974f49ca465 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-07370334-d6e4-4022-8f38-8974f49ca465 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-07370334-d6e4-4022-8f38-8974f49ca465 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-07370334-d6e4-4022-8f38-8974f49ca465 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:43 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-07370334-d6e4-4022-8f38-8974f49ca465 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048327 Apr 14 16:12:43 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 341/1025] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 16:12:43 2023] GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:12:55 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:55 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:55 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3f970b17-b54d-4319-99e9-2864a6651918 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:12:55 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-3f970b17-b54d-4319-99e9-2864a6651918 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:12:55 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3f970b17-b54d-4319-99e9-2864a6651918 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:55 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3f970b17-b54d-4319-99e9-2864a6651918 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:55 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3f970b17-b54d-4319-99e9-2864a6651918 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:55 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3f970b17-b54d-4319-99e9-2864a6651918 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:12:55 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3f970b17-b54d-4319-99e9-2864a6651918 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:12:55 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3f970b17-b54d-4319-99e9-2864a6651918 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:12:55 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-3f970b17-b54d-4319-99e9-2864a6651918 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] HTTP exception thrown: Instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 could not be found. Apr 14 16:12:55 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3f970b17-b54d-4319-99e9-2864a6651918 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Request method failure captured: Apr 14 16:12:55 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57 HTTP/1.1 Apr 14 16:12:55 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:12:55 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:12:55 user devstack@n-api.service[61875]: Connection: close Apr 14 16:12:55 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:12:55 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:12:55 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:12:55 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:12:55 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXn5_DpKeEBKSReFjquNQ0GccC2BE_qt1GsJToWQUMscv0hZ1Z4zWTB8OjBZ2CCrxtWn3Lr4pVD17o8GNh0B53zcJU91VjQ-3Q1puPoyai2Eu-SMp_wZbatCTBwpZsTHaqJoadxSYFDSrHd1PwsqtAssDyTxATElDGjL2dyaPsnpRMc Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Project-Id: 0f145f9471aa46ab88e93a9d4c7a4535 Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Project-Name: tempest-TestShelveInstance-1830025798 Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f145f9471aa46ab88e93a9d4c7a4535"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f145f9471aa46ab88e93a9d4c7a4535"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f145f9471aa46ab88e93a9d4c7a4535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Tenant: tempest-TestShelveInstance-1830025798 Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Tenant-Id: 0f145f9471aa46ab88e93a9d4c7a4535 Apr 14 16:12:55 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-TestShelveInstance-1830025798 Apr 14 16:12:55 user devstack@n-api.service[61875]: X-User: tempest-TestShelveInstance-1830025798-project-member Apr 14 16:12:55 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:12:55 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:12:55 user devstack@n-api.service[61875]: X-User-Id: ca751b25580040a2b48039142c91d58f Apr 14 16:12:55 user devstack@n-api.service[61875]: X-User-Name: tempest-TestShelveInstance-1830025798-project-member Apr 14 16:12:55 user devstack@n-api.service[61875]: method: > Apr 14 16:12:55 user devstack@n-api.service[61875]: exception: Instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 could not be found. Apr 14 16:12:55 user devstack@n-api.service[61875]: action_args: {'id': '8fbd3667-302e-4f1f-8e58-2bdabe5efe57'} Apr 14 16:12:55 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 could not be found. Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 could not be found. Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 could not be found. Apr 14 16:12:55 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:12:55 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3f970b17-b54d-4319-99e9-2864a6651918 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Returning 404 to user: Instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:12:55 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-3f970b17-b54d-4319-99e9-2864a6651918 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57" status: 404 len: 111 microversion: 2.1 time: 0.037255 Apr 14 16:12:55 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 342/1026] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:12:55 2023] GET /compute/v2.1/servers/8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:12:56 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:56 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:12:56 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-accc993d-b244-45fb-8d7d-e985dc11adee tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Calling method '.version_select at 0x7f297084beb0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:12:56 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-accc993d-b244-45fb-8d7d-e985dc11adee tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-163308382" status: 202 len: 0 microversion: 2.1 time: 0.026220 Apr 14 16:12:56 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 344/1027] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 16:12:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-163308382 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:13:13 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-c0583af2-69fa-4135-8d54-1fb773c3c5a6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:13:13 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-c0583af2-69fa-4135-8d54-1fb773c3c5a6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:13:13 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:13:13 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:13:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c0583af2-69fa-4135-8d54-1fb773c3c5a6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c0583af2-69fa-4135-8d54-1fb773c3c5a6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c0583af2-69fa-4135-8d54-1fb773c3c5a6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c0583af2-69fa-4135-8d54-1fb773c3c5a6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c0583af2-69fa-4135-8d54-1fb773c3c5a6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:13 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c0583af2-69fa-4135-8d54-1fb773c3c5a6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:13 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-c0583af2-69fa-4135-8d54-1fb773c3c5a6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6061fcff5317445cab3a8da6f24d9ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fb9ccf20ec4ef2a6b64004df0061e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:13:13 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-c0583af2-69fa-4135-8d54-1fb773c3c5a6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5355a43-4e93-484e-87ad-6e179c8821c2" status: 200 len: 1483 microversion: 2.1 time: 0.247660 Apr 14 16:13:13 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 342/1028] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:13:13 2023] GET /compute/v2.1/servers/f5355a43-4e93-484e-87ad-6e179c8821c2 => generated 1483 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:27 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1494473776", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "798fb31f-f689-4dde-8a93-4365398d456f", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "43ce94ae-5ff4-4006-b800-67d1f29a9898"}]}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:27 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:13:27 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:13:27 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] validate_networks() for [('43ce94ae-5ff4-4006-b800-67d1f29a9898', None, None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for user bb3b7ae19e044c3e90292751dd633279 and project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:13:28 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='798fb31f-f689-4dde-8a93-4365398d456f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:13:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.504549 Apr 14 16:13:28 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 343/1029] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:13:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:13:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:13:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-38494385-18e0-45f6-be7b-faf028eae658 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:13:28 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-38494385-18e0-45f6-be7b-faf028eae658 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:13:28 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-38494385-18e0-45f6-be7b-faf028eae658 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:13:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-38494385-18e0-45f6-be7b-faf028eae658 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a" status: 200 len: 1052 microversion: 2.1 time: 0.077163 Apr 14 16:13:28 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 345/1030] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:13:28 2023] GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a => generated 1052 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:30 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54af8caf-09fa-4ada-b446-91e43876581a", "tag": "b31de579-1646-47cd-a9d8-9e45df05addf"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:30 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:13:30 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:13:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:30 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:30 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] Creating event network-changed:b31de579-1646-47cd-a9d8-9e45df05addf for instance 54af8caf-09fa-4ada-b446-91e43876581a on user Apr 14 16:13:31 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034073 Apr 14 16:13:31 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 343/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:13:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:33 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-db19804a-47b7-4b11-afa2-97db841bfb90 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:13:33 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-db19804a-47b7-4b11-afa2-97db841bfb90 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:13:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-db19804a-47b7-4b11-afa2-97db841bfb90 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-db19804a-47b7-4b11-afa2-97db841bfb90 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-db19804a-47b7-4b11-afa2-97db841bfb90 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-db19804a-47b7-4b11-afa2-97db841bfb90 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-db19804a-47b7-4b11-afa2-97db841bfb90 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:33 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-db19804a-47b7-4b11-afa2-97db841bfb90 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:33 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-db19804a-47b7-4b11-afa2-97db841bfb90 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042670 Apr 14 16:13:33 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 344/1032] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 16:13:33 2023] GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 16:13:33 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:13:33 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:13:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:33 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:33 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Going to try to terminate instance {{(pid=61876) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:13:33 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258" status: 204 len: 0 microversion: 2.1 time: 0.118102 Apr 14 16:13:33 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 346/1033] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:13:33 2023] DELETE /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:13:33 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-def7007f-bf92-43ed-98a5-5344fea3e309 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:13:33 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-def7007f-bf92-43ed-98a5-5344fea3e309 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:13:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-def7007f-bf92-43ed-98a5-5344fea3e309 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-def7007f-bf92-43ed-98a5-5344fea3e309 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-def7007f-bf92-43ed-98a5-5344fea3e309 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-def7007f-bf92-43ed-98a5-5344fea3e309 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-def7007f-bf92-43ed-98a5-5344fea3e309 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-def7007f-bf92-43ed-98a5-5344fea3e309 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:33 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-7edda3c7-4e83-4758-af7a-e85fff2406be req-66ca2663-a54f-412f-bc0f-bab0dc4dfcf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1963f30-fea7-49f0-aa6d-5df33a362258", "name": "network-vif-unplugged", "status": "completed", "tag": "a088891b-f698-4783-8b4d-caacf03d3747"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7edda3c7-4e83-4758-af7a-e85fff2406be req-66ca2663-a54f-412f-bc0f-bab0dc4dfcf5 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7edda3c7-4e83-4758-af7a-e85fff2406be req-66ca2663-a54f-412f-bc0f-bab0dc4dfcf5 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7edda3c7-4e83-4758-af7a-e85fff2406be req-66ca2663-a54f-412f-bc0f-bab0dc4dfcf5 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:34 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-7edda3c7-4e83-4758-af7a-e85fff2406be req-66ca2663-a54f-412f-bc0f-bab0dc4dfcf5 service nova] Creating event network-vif-unplugged:a088891b-f698-4783-8b4d-caacf03d3747 for instance f1963f30-fea7-49f0-aa6d-5df33a362258 on user Apr 14 16:13:34 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-7edda3c7-4e83-4758-af7a-e85fff2406be req-66ca2663-a54f-412f-bc0f-bab0dc4dfcf5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028348 Apr 14 16:13:34 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 345/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:13:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:13:34 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-def7007f-bf92-43ed-98a5-5344fea3e309 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:13:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-def7007f-bf92-43ed-98a5-5344fea3e309 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258" status: 200 len: 1670 microversion: 2.1 time: 0.475348 Apr 14 16:13:34 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 344/1035] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:13:33 2023] GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258 => generated 1670 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:13:35 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-d57608be-d8e8-4893-8802-34fbc995b8f8 req-932352eb-9fda-4f23-95a8-aa0111933682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1963f30-fea7-49f0-aa6d-5df33a362258", "name": "network-vif-deleted", "tag": "a088891b-f698-4783-8b4d-caacf03d3747"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d57608be-d8e8-4893-8802-34fbc995b8f8 req-932352eb-9fda-4f23-95a8-aa0111933682 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d57608be-d8e8-4893-8802-34fbc995b8f8 req-932352eb-9fda-4f23-95a8-aa0111933682 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:35 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d57608be-d8e8-4893-8802-34fbc995b8f8 req-932352eb-9fda-4f23-95a8-aa0111933682 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:35 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d57608be-d8e8-4893-8802-34fbc995b8f8 req-932352eb-9fda-4f23-95a8-aa0111933682 service nova] Creating event network-vif-deleted:a088891b-f698-4783-8b4d-caacf03d3747 for instance f1963f30-fea7-49f0-aa6d-5df33a362258 on user Apr 14 16:13:35 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-d57608be-d8e8-4893-8802-34fbc995b8f8 req-932352eb-9fda-4f23-95a8-aa0111933682 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051912 Apr 14 16:13:35 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 347/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:13:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:36 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-fd5da5de-a183-4f91-b772-5c2386c88673 req-3c5c4cfb-52ef-4811-acdd-8ea7f0d9e096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1963f30-fea7-49f0-aa6d-5df33a362258", "name": "network-vif-plugged", "status": "completed", "tag": "a088891b-f698-4783-8b4d-caacf03d3747"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fd5da5de-a183-4f91-b772-5c2386c88673 req-3c5c4cfb-52ef-4811-acdd-8ea7f0d9e096 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fd5da5de-a183-4f91-b772-5c2386c88673 req-3c5c4cfb-52ef-4811-acdd-8ea7f0d9e096 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fd5da5de-a183-4f91-b772-5c2386c88673 req-3c5c4cfb-52ef-4811-acdd-8ea7f0d9e096 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-fd5da5de-a183-4f91-b772-5c2386c88673 req-3c5c4cfb-52ef-4811-acdd-8ea7f0d9e096 service nova] Creating event network-vif-plugged:a088891b-f698-4783-8b4d-caacf03d3747 for instance f1963f30-fea7-49f0-aa6d-5df33a362258 on user Apr 14 16:13:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-fd5da5de-a183-4f91-b772-5c2386c88673 req-3c5c4cfb-52ef-4811-acdd-8ea7f0d9e096 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045391 Apr 14 16:13:36 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 346/1037] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:13:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:42 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-37693e7b-2ee8-4e0c-ad51-daa3574965c4 req-dad74c9a-6f2b-40c3-b861-f3448ed6c6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54af8caf-09fa-4ada-b446-91e43876581a", "name": "network-vif-plugged", "status": "completed", "tag": "b31de579-1646-47cd-a9d8-9e45df05addf"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-37693e7b-2ee8-4e0c-ad51-daa3574965c4 req-dad74c9a-6f2b-40c3-b861-f3448ed6c6c0 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-37693e7b-2ee8-4e0c-ad51-daa3574965c4 req-dad74c9a-6f2b-40c3-b861-f3448ed6c6c0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:42 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-37693e7b-2ee8-4e0c-ad51-daa3574965c4 req-dad74c9a-6f2b-40c3-b861-f3448ed6c6c0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:42 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-37693e7b-2ee8-4e0c-ad51-daa3574965c4 req-dad74c9a-6f2b-40c3-b861-f3448ed6c6c0 service nova] Creating event network-vif-plugged:b31de579-1646-47cd-a9d8-9e45df05addf for instance 54af8caf-09fa-4ada-b446-91e43876581a on user Apr 14 16:13:42 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-37693e7b-2ee8-4e0c-ad51-daa3574965c4 req-dad74c9a-6f2b-40c3-b861-f3448ed6c6c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048018 Apr 14 16:13:42 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 345/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:13:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:13:44 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:13:44 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-9b8f7ad7-464f-47ef-beb9-3773d2e29af1 req-70d79fc9-10e1-49fb-ac21-4546f4b3f129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54af8caf-09fa-4ada-b446-91e43876581a", "name": "network-vif-plugged", "status": "completed", "tag": "b31de579-1646-47cd-a9d8-9e45df05addf"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:13:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9b8f7ad7-464f-47ef-beb9-3773d2e29af1 req-70d79fc9-10e1-49fb-ac21-4546f4b3f129 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:13:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9b8f7ad7-464f-47ef-beb9-3773d2e29af1 req-70d79fc9-10e1-49fb-ac21-4546f4b3f129 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:13:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9b8f7ad7-464f-47ef-beb9-3773d2e29af1 req-70d79fc9-10e1-49fb-ac21-4546f4b3f129 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:13:44 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-9b8f7ad7-464f-47ef-beb9-3773d2e29af1 req-70d79fc9-10e1-49fb-ac21-4546f4b3f129 service nova] Creating event network-vif-plugged:b31de579-1646-47cd-a9d8-9e45df05addf for instance 54af8caf-09fa-4ada-b446-91e43876581a on user Apr 14 16:13:44 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-9b8f7ad7-464f-47ef-beb9-3773d2e29af1 req-70d79fc9-10e1-49fb-ac21-4546f4b3f129 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046008 Apr 14 16:13:44 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 348/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:13:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:14:14 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:14:14 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:14:14 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:14:14 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:14:14 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:14:14 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=12 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:14:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:14 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:14 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:14:14 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f5355a43-4e93-484e-87ad-6e179c8821c2" status: 204 len: 0 microversion: 2.1 time: 0.127908 Apr 14 16:14:14 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 347/1040] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:14:14 2023] DELETE /compute/v2.1/servers/f5355a43-4e93-484e-87ad-6e179c8821c2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:14:14 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-70eee064-948d-4ac1-9322-cabd7ae77806 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:14:14 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-70eee064-948d-4ac1-9322-cabd7ae77806 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:14:14 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:14:14 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=10 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:14:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-70eee064-948d-4ac1-9322-cabd7ae77806 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-70eee064-948d-4ac1-9322-cabd7ae77806 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-70eee064-948d-4ac1-9322-cabd7ae77806 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-70eee064-948d-4ac1-9322-cabd7ae77806 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-70eee064-948d-4ac1-9322-cabd7ae77806 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:14 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-70eee064-948d-4ac1-9322-cabd7ae77806 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:14 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:14:14 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:14:14 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-70eee064-948d-4ac1-9322-cabd7ae77806 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6061fcff5317445cab3a8da6f24d9ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fb9ccf20ec4ef2a6b64004df0061e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:14:14 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-cb7a5649-7388-4bf3-82db-7a88f118707d req-d70e0732-79bd-4f17-b19a-d0fbc13f21eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5355a43-4e93-484e-87ad-6e179c8821c2", "name": "network-vif-unplugged", "status": "completed", "tag": "fd90e988-80fd-4292-af7a-719a534d38db"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:14 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-70eee064-948d-4ac1-9322-cabd7ae77806 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5355a43-4e93-484e-87ad-6e179c8821c2" status: 200 len: 1489 microversion: 2.1 time: 0.253663 Apr 14 16:14:14 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 346/1041] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:14:14 2023] GET /compute/v2.1/servers/f5355a43-4e93-484e-87ad-6e179c8821c2 => generated 1489 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-cb7a5649-7388-4bf3-82db-7a88f118707d req-d70e0732-79bd-4f17-b19a-d0fbc13f21eb service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-cb7a5649-7388-4bf3-82db-7a88f118707d req-d70e0732-79bd-4f17-b19a-d0fbc13f21eb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:14 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-cb7a5649-7388-4bf3-82db-7a88f118707d req-d70e0732-79bd-4f17-b19a-d0fbc13f21eb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:14 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-cb7a5649-7388-4bf3-82db-7a88f118707d req-d70e0732-79bd-4f17-b19a-d0fbc13f21eb service nova] Creating event network-vif-unplugged:fd90e988-80fd-4292-af7a-719a534d38db for instance f5355a43-4e93-484e-87ad-6e179c8821c2 on user Apr 14 16:14:14 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-cb7a5649-7388-4bf3-82db-7a88f118707d req-d70e0732-79bd-4f17-b19a-d0fbc13f21eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046777 Apr 14 16:14:14 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 349/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:14:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:14:15 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-c7f3f0db-6ef1-4c83-a614-0596acdd7063 req-5d2cae81-9439-4781-8745-2a0f2d959264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5355a43-4e93-484e-87ad-6e179c8821c2", "name": "network-vif-deleted", "tag": "fd90e988-80fd-4292-af7a-719a534d38db"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c7f3f0db-6ef1-4c83-a614-0596acdd7063 req-5d2cae81-9439-4781-8745-2a0f2d959264 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c7f3f0db-6ef1-4c83-a614-0596acdd7063 req-5d2cae81-9439-4781-8745-2a0f2d959264 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:15 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c7f3f0db-6ef1-4c83-a614-0596acdd7063 req-5d2cae81-9439-4781-8745-2a0f2d959264 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:15 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c7f3f0db-6ef1-4c83-a614-0596acdd7063 req-5d2cae81-9439-4781-8745-2a0f2d959264 service nova] Creating event network-vif-deleted:fd90e988-80fd-4292-af7a-719a534d38db for instance f5355a43-4e93-484e-87ad-6e179c8821c2 on user Apr 14 16:14:15 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-c7f3f0db-6ef1-4c83-a614-0596acdd7063 req-5d2cae81-9439-4781-8745-2a0f2d959264 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032354 Apr 14 16:14:15 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 348/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:14:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:14:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-abf28d94-9f64-436a-8b06-9da87599adf4 req-875ba7a3-5948-41c3-b942-1319dbce7860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5355a43-4e93-484e-87ad-6e179c8821c2", "name": "network-vif-plugged", "status": "completed", "tag": "fd90e988-80fd-4292-af7a-719a534d38db"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:14:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-abf28d94-9f64-436a-8b06-9da87599adf4 req-875ba7a3-5948-41c3-b942-1319dbce7860 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-abf28d94-9f64-436a-8b06-9da87599adf4 req-875ba7a3-5948-41c3-b942-1319dbce7860 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-abf28d94-9f64-436a-8b06-9da87599adf4 req-875ba7a3-5948-41c3-b942-1319dbce7860 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:16 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-abf28d94-9f64-436a-8b06-9da87599adf4 req-875ba7a3-5948-41c3-b942-1319dbce7860 service nova] Creating event network-vif-plugged:fd90e988-80fd-4292-af7a-719a534d38db for instance f5355a43-4e93-484e-87ad-6e179c8821c2 on user Apr 14 16:14:16 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-abf28d94-9f64-436a-8b06-9da87599adf4 req-875ba7a3-5948-41c3-b942-1319dbce7860 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027926 Apr 14 16:14:16 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 347/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:14:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:14:18 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-496c9102-e5ce-4dc4-b46d-fcad281e6e2b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:14:18 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-496c9102-e5ce-4dc4-b46d-fcad281e6e2b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:14:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-496c9102-e5ce-4dc4-b46d-fcad281e6e2b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-496c9102-e5ce-4dc4-b46d-fcad281e6e2b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-496c9102-e5ce-4dc4-b46d-fcad281e6e2b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-496c9102-e5ce-4dc4-b46d-fcad281e6e2b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-496c9102-e5ce-4dc4-b46d-fcad281e6e2b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:18 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-496c9102-e5ce-4dc4-b46d-fcad281e6e2b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:18 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-496c9102-e5ce-4dc4-b46d-fcad281e6e2b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:14:18 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-496c9102-e5ce-4dc4-b46d-fcad281e6e2b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a" status: 200 len: 1379 microversion: 2.1 time: 0.239979 Apr 14 16:14:18 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 350/1045] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:14:18 2023] GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a => generated 1379 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:14:24 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a46e4f86-529e-483c-8852-52763ebe47b0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:14:24 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-a46e4f86-529e-483c-8852-52763ebe47b0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:14:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a46e4f86-529e-483c-8852-52763ebe47b0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a46e4f86-529e-483c-8852-52763ebe47b0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a46e4f86-529e-483c-8852-52763ebe47b0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a46e4f86-529e-483c-8852-52763ebe47b0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a46e4f86-529e-483c-8852-52763ebe47b0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:24 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-a46e4f86-529e-483c-8852-52763ebe47b0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-a46e4f86-529e-483c-8852-52763ebe47b0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:24 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a46e4f86-529e-483c-8852-52763ebe47b0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:14:24 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258 HTTP/1.1 Apr 14 16:14:24 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:14:24 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:14:24 user devstack@n-api.service[61875]: Connection: close Apr 14 16:14:24 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:14:24 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:14:24 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:14:24 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:14:24 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:24 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:24 user devstack@n-api.service[61875]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:24 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:14:24 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:14:24 user devstack@n-api.service[61875]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:14:24 user devstack@n-api.service[61875]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:24 user devstack@n-api.service[61875]: method: > Apr 14 16:14:24 user devstack@n-api.service[61875]: exception: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:24 user devstack@n-api.service[61875]: action_args: {'id': 'f1963f30-fea7-49f0-aa6d-5df33a362258'} Apr 14 16:14:24 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:24 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:24 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-a46e4f86-529e-483c-8852-52763ebe47b0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 404 to user: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:14:24 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-a46e4f86-529e-483c-8852-52763ebe47b0 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258" status: 404 len: 111 microversion: 2.1 time: 0.030642 Apr 14 16:14:24 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 349/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:14:24 2023] GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:24 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-f6cdaefc-421f-4179-afcd-f22ff9e13762 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '.version_select at 0x7f297075c4c0>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:14:24 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-f6cdaefc-421f-4179-afcd-f22ff9e13762 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020858187" status: 202 len: 0 microversion: 2.1 time: 0.021846 Apr 14 16:14:24 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 348/1047] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 16:14:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020858187 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:14:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-41170264-4245-4e6b-aa1d-15c3c4c34ffd tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:14:28 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-41170264-4245-4e6b-aa1d-15c3c4c34ffd tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:14:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-41170264-4245-4e6b-aa1d-15c3c4c34ffd tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-41170264-4245-4e6b-aa1d-15c3c4c34ffd tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-41170264-4245-4e6b-aa1d-15c3c4c34ffd tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-41170264-4245-4e6b-aa1d-15c3c4c34ffd tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-41170264-4245-4e6b-aa1d-15c3c4c34ffd tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-41170264-4245-4e6b-aa1d-15c3c4c34ffd tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-41170264-4245-4e6b-aa1d-15c3c4c34ffd tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-41170264-4245-4e6b-aa1d-15c3c4c34ffd tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:14:28 user devstack@n-api.service[61876]: request: DELETE /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258 HTTP/1.1 Apr 14 16:14:28 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:14:28 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:14:28 user devstack@n-api.service[61876]: Connection: close Apr 14 16:14:28 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:14:28 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:14:28 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:14:28 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:14:28 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:28 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:28 user devstack@n-api.service[61876]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:28 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:14:28 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:14:28 user devstack@n-api.service[61876]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:14:28 user devstack@n-api.service[61876]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:28 user devstack@n-api.service[61876]: method: > Apr 14 16:14:28 user devstack@n-api.service[61876]: exception: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:28 user devstack@n-api.service[61876]: action_args: {'id': 'f1963f30-fea7-49f0-aa6d-5df33a362258'} Apr 14 16:14:28 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-41170264-4245-4e6b-aa1d-15c3c4c34ffd tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 404 to user: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:14:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-41170264-4245-4e6b-aa1d-15c3c4c34ffd tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258" status: 404 len: 111 microversion: 2.1 time: 0.032247 Apr 14 16:14:28 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 351/1048] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:14:28 2023] DELETE /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c8bbda10-8d87-47df-af84-6088efd403a5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:14:28 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-c8bbda10-8d87-47df-af84-6088efd403a5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:14:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c8bbda10-8d87-47df-af84-6088efd403a5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c8bbda10-8d87-47df-af84-6088efd403a5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c8bbda10-8d87-47df-af84-6088efd403a5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c8bbda10-8d87-47df-af84-6088efd403a5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c8bbda10-8d87-47df-af84-6088efd403a5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-c8bbda10-8d87-47df-af84-6088efd403a5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-c8bbda10-8d87-47df-af84-6088efd403a5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c8bbda10-8d87-47df-af84-6088efd403a5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:14:28 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258 HTTP/1.1 Apr 14 16:14:28 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:14:28 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:14:28 user devstack@n-api.service[61875]: Connection: close Apr 14 16:14:28 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:14:28 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:14:28 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:14:28 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:14:28 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:28 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:28 user devstack@n-api.service[61875]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:28 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:14:28 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:14:28 user devstack@n-api.service[61875]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:14:28 user devstack@n-api.service[61875]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:28 user devstack@n-api.service[61875]: method: > Apr 14 16:14:28 user devstack@n-api.service[61875]: exception: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:28 user devstack@n-api.service[61875]: action_args: {'id': 'f1963f30-fea7-49f0-aa6d-5df33a362258'} Apr 14 16:14:28 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. Apr 14 16:14:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-c8bbda10-8d87-47df-af84-6088efd403a5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 404 to user: Instance f1963f30-fea7-49f0-aa6d-5df33a362258 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:14:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-c8bbda10-8d87-47df-af84-6088efd403a5 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258" status: 404 len: 111 microversion: 2.1 time: 0.031041 Apr 14 16:14:28 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 350/1049] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:14:28 2023] GET /compute/v2.1/servers/f1963f30-fea7-49f0-aa6d-5df33a362258 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=8 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-56631626-610f-448c-840e-12ce3b106733 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-56631626-610f-448c-840e-12ce3b106733 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-56631626-610f-448c-840e-12ce3b106733 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-56631626-610f-448c-840e-12ce3b106733 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-56631626-610f-448c-840e-12ce3b106733 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-56631626-610f-448c-840e-12ce3b106733 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-56631626-610f-448c-840e-12ce3b106733 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-56631626-610f-448c-840e-12ce3b106733 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:31 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-56631626-610f-448c-840e-12ce3b106733 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-56631626-610f-448c-840e-12ce3b106733 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:14:31 user devstack@n-api.service[61874]: request: DELETE /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611 HTTP/1.1 Apr 14 16:14:31 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:14:31 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:14:31 user devstack@n-api.service[61874]: Connection: close Apr 14 16:14:31 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:14:31 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:14:31 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:14:31 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:14:31 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:31 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:14:31 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:14:31 user devstack@n-api.service[61874]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:31 user devstack@n-api.service[61874]: method: > Apr 14 16:14:31 user devstack@n-api.service[61874]: exception: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:14:31 user devstack@n-api.service[61874]: action_args: {'id': '971c41c2-4757-4a9c-bef7-aff8b6386611'} Apr 14 16:14:31 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-56631626-610f-448c-840e-12ce3b106733 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 404 to user: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:14:31 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-56631626-610f-448c-840e-12ce3b106733 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611" status: 404 len: 111 microversion: 2.1 time: 0.033046 Apr 14 16:14:31 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 349/1050] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:14:31 2023] DELETE /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-aab7bb10-3544-4c68-8dfc-1fb10dfa4f73 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:14:31 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-aab7bb10-3544-4c68-8dfc-1fb10dfa4f73 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:14:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aab7bb10-3544-4c68-8dfc-1fb10dfa4f73 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aab7bb10-3544-4c68-8dfc-1fb10dfa4f73 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aab7bb10-3544-4c68-8dfc-1fb10dfa4f73 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aab7bb10-3544-4c68-8dfc-1fb10dfa4f73 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aab7bb10-3544-4c68-8dfc-1fb10dfa4f73 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:31 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-aab7bb10-3544-4c68-8dfc-1fb10dfa4f73 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-aab7bb10-3544-4c68-8dfc-1fb10dfa4f73 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:14:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-aab7bb10-3544-4c68-8dfc-1fb10dfa4f73 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:14:31 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611 HTTP/1.1 Apr 14 16:14:31 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:14:31 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:14:31 user devstack@n-api.service[61876]: Connection: close Apr 14 16:14:31 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:14:31 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:14:31 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:14:31 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:14:31 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:31 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:31 user devstack@n-api.service[61876]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:31 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:14:31 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:14:31 user devstack@n-api.service[61876]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:14:31 user devstack@n-api.service[61876]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:31 user devstack@n-api.service[61876]: method: > Apr 14 16:14:31 user devstack@n-api.service[61876]: exception: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:14:31 user devstack@n-api.service[61876]: action_args: {'id': '971c41c2-4757-4a9c-bef7-aff8b6386611'} Apr 14 16:14:31 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. Apr 14 16:14:31 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-aab7bb10-3544-4c68-8dfc-1fb10dfa4f73 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 404 to user: Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:14:31 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-aab7bb10-3544-4c68-8dfc-1fb10dfa4f73 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611" status: 404 len: 111 microversion: 2.1 time: 0.035854 Apr 14 16:14:31 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 352/1051] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:14:31 2023] GET /compute/v2.1/servers/971c41c2-4757-4a9c-bef7-aff8b6386611 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:31 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b75dcb9c-9465-42b7-bd24-40e35c781d21 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:14:31 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-b75dcb9c-9465-42b7-bd24-40e35c781d21 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:14:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b75dcb9c-9465-42b7-bd24-40e35c781d21 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b75dcb9c-9465-42b7-bd24-40e35c781d21 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b75dcb9c-9465-42b7-bd24-40e35c781d21 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b75dcb9c-9465-42b7-bd24-40e35c781d21 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b75dcb9c-9465-42b7-bd24-40e35c781d21 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:31 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b75dcb9c-9465-42b7-bd24-40e35c781d21 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:31 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-b75dcb9c-9465-42b7-bd24-40e35c781d21 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:14:31 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b75dcb9c-9465-42b7-bd24-40e35c781d21 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:14:31 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e HTTP/1.1 Apr 14 16:14:31 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:14:31 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:14:31 user devstack@n-api.service[61875]: Connection: close Apr 14 16:14:31 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:14:31 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:14:31 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:14:31 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:14:31 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:31 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:31 user devstack@n-api.service[61875]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:31 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:14:31 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:14:31 user devstack@n-api.service[61875]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:14:31 user devstack@n-api.service[61875]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:31 user devstack@n-api.service[61875]: method: > Apr 14 16:14:31 user devstack@n-api.service[61875]: exception: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:14:31 user devstack@n-api.service[61875]: action_args: {'id': '9f624c54-a234-49d3-9e25-a69043cffd3e'} Apr 14 16:14:31 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:14:31 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b75dcb9c-9465-42b7-bd24-40e35c781d21 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 404 to user: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:14:31 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-b75dcb9c-9465-42b7-bd24-40e35c781d21 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e" status: 404 len: 111 microversion: 2.1 time: 0.041011 Apr 14 16:14:31 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 351/1052] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:14:31 2023] DELETE /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-6d671bf5-c324-4e10-bb27-4b6cccc5edc4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-6d671bf5-c324-4e10-bb27-4b6cccc5edc4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6d671bf5-c324-4e10-bb27-4b6cccc5edc4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6d671bf5-c324-4e10-bb27-4b6cccc5edc4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6d671bf5-c324-4e10-bb27-4b6cccc5edc4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6d671bf5-c324-4e10-bb27-4b6cccc5edc4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6d671bf5-c324-4e10-bb27-4b6cccc5edc4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6d671bf5-c324-4e10-bb27-4b6cccc5edc4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:31 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-6d671bf5-c324-4e10-bb27-4b6cccc5edc4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-6d671bf5-c324-4e10-bb27-4b6cccc5edc4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:14:31 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e HTTP/1.1 Apr 14 16:14:31 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:14:31 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:14:31 user devstack@n-api.service[61874]: Connection: close Apr 14 16:14:31 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:14:31 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:14:31 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:14:31 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:14:31 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:31 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:14:31 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:14:31 user devstack@n-api.service[61874]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:14:31 user devstack@n-api.service[61874]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:31 user devstack@n-api.service[61874]: method: > Apr 14 16:14:31 user devstack@n-api.service[61874]: exception: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:14:31 user devstack@n-api.service[61874]: action_args: {'id': '9f624c54-a234-49d3-9e25-a69043cffd3e'} Apr 14 16:14:31 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. Apr 14 16:14:31 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:14:31 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-6d671bf5-c324-4e10-bb27-4b6cccc5edc4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 404 to user: Instance 9f624c54-a234-49d3-9e25-a69043cffd3e could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:14:31 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-6d671bf5-c324-4e10-bb27-4b6cccc5edc4 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e" status: 404 len: 111 microversion: 2.1 time: 0.039134 Apr 14 16:14:31 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 350/1053] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:14:31 2023] GET /compute/v2.1/servers/9f624c54-a234-49d3-9e25-a69043cffd3e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:34 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-84374680-9cc4-4f56-9ce1-186ba28a4688 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:14:34 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-84374680-9cc4-4f56-9ce1-186ba28a4688 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:14:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-84374680-9cc4-4f56-9ce1-186ba28a4688 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-84374680-9cc4-4f56-9ce1-186ba28a4688 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-84374680-9cc4-4f56-9ce1-186ba28a4688 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-84374680-9cc4-4f56-9ce1-186ba28a4688 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-84374680-9cc4-4f56-9ce1-186ba28a4688 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-84374680-9cc4-4f56-9ce1-186ba28a4688 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:35 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-84374680-9cc4-4f56-9ce1-186ba28a4688 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:14:35 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-84374680-9cc4-4f56-9ce1-186ba28a4688 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:14:35 user devstack@n-api.service[61876]: request: DELETE /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff HTTP/1.1 Apr 14 16:14:35 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:14:35 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:14:35 user devstack@n-api.service[61876]: Connection: close Apr 14 16:14:35 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:14:35 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:14:35 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:14:35 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:14:35 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:35 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:35 user devstack@n-api.service[61876]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:35 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:14:35 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:14:35 user devstack@n-api.service[61876]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:14:35 user devstack@n-api.service[61876]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:35 user devstack@n-api.service[61876]: method: > Apr 14 16:14:35 user devstack@n-api.service[61876]: exception: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:14:35 user devstack@n-api.service[61876]: action_args: {'id': '85ad8a8f-d9e8-4f74-a16f-449616e970ff'} Apr 14 16:14:35 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:14:35 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:14:35 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-84374680-9cc4-4f56-9ce1-186ba28a4688 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 404 to user: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:14:35 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-84374680-9cc4-4f56-9ce1-186ba28a4688 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff" status: 404 len: 111 microversion: 2.1 time: 0.054593 Apr 14 16:14:35 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 353/1054] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:14:34 2023] DELETE /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:14:35 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-e18e9f71-f1bd-429c-ae09-f152c989ecfb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:14:35 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-e18e9f71-f1bd-429c-ae09-f152c989ecfb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:14:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e18e9f71-f1bd-429c-ae09-f152c989ecfb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e18e9f71-f1bd-429c-ae09-f152c989ecfb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e18e9f71-f1bd-429c-ae09-f152c989ecfb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e18e9f71-f1bd-429c-ae09-f152c989ecfb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:14:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e18e9f71-f1bd-429c-ae09-f152c989ecfb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:14:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-e18e9f71-f1bd-429c-ae09-f152c989ecfb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:14:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-e18e9f71-f1bd-429c-ae09-f152c989ecfb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HTTP exception thrown: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:14:35 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-e18e9f71-f1bd-429c-ae09-f152c989ecfb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Request method failure captured: Apr 14 16:14:35 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff HTTP/1.1 Apr 14 16:14:35 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:14:35 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:14:35 user devstack@n-api.service[61875]: Connection: close Apr 14 16:14:35 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:14:35 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:14:35 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:14:35 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:14:35 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXiThQ-s9FiDOVh60dc-t_6ISKi5UcWtfw3denYffmvCjUfgdfqPLoxRKn4OAFEmA7A-de7vqil4p7fVykemNIZZ_bTz3NGtEtZM-kHn0VtBpkK9XXFjoPfX6kayDuHoHgA-CqOxT07v86_QrrvyTLQlYGNlpWrJWGY9M_U0s_HRFsQ Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Project-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Project-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecb4d204dbf24c19b978456d16d19e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Tenant: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Tenant-Id: ecb4d204dbf24c19b978456d16d19e87 Apr 14 16:14:35 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-378331452 Apr 14 16:14:35 user devstack@n-api.service[61875]: X-User: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:35 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:14:35 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:14:35 user devstack@n-api.service[61875]: X-User-Id: 2d83796cd8d5464fa4e580844441da81 Apr 14 16:14:35 user devstack@n-api.service[61875]: X-User-Name: tempest-AttachVolumeNegativeTest-378331452-project-member Apr 14 16:14:35 user devstack@n-api.service[61875]: method: > Apr 14 16:14:35 user devstack@n-api.service[61875]: exception: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:14:35 user devstack@n-api.service[61875]: action_args: {'id': '85ad8a8f-d9e8-4f74-a16f-449616e970ff'} Apr 14 16:14:35 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. Apr 14 16:14:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:14:35 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-e18e9f71-f1bd-429c-ae09-f152c989ecfb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Returning 404 to user: Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:14:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-e18e9f71-f1bd-429c-ae09-f152c989ecfb tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff" status: 404 len: 111 microversion: 2.1 time: 0.047832 Apr 14 16:14:35 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 352/1055] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:14:35 2023] GET /compute/v2.1/servers/85ad8a8f-d9e8-4f74-a16f-449616e970ff => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:15:04 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2d0099c4-a760-489b-9913-206ab93ceb1c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:15:04 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-2d0099c4-a760-489b-9913-206ab93ceb1c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:15:04 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:15:04 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:15:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2d0099c4-a760-489b-9913-206ab93ceb1c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2d0099c4-a760-489b-9913-206ab93ceb1c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2d0099c4-a760-489b-9913-206ab93ceb1c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2d0099c4-a760-489b-9913-206ab93ceb1c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2d0099c4-a760-489b-9913-206ab93ceb1c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2d0099c4-a760-489b-9913-206ab93ceb1c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:04 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-2d0099c4-a760-489b-9913-206ab93ceb1c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] HTTP exception thrown: Instance f5355a43-4e93-484e-87ad-6e179c8821c2 could not be found. Apr 14 16:15:04 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2d0099c4-a760-489b-9913-206ab93ceb1c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Request method failure captured: Apr 14 16:15:04 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/f5355a43-4e93-484e-87ad-6e179c8821c2 HTTP/1.1 Apr 14 16:15:04 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:15:04 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:15:04 user devstack@n-api.service[61874]: Connection: close Apr 14 16:15:04 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:15:04 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:15:04 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:15:04 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:15:04 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXtjqnrYdb91bsrIrGfJeu7fpfLw_2L_KHEOhvcvjnWC41xp6RXtUErtDDeV4FK-uBr6OcVXaQ8xvFMYPuyxhBSKu5X8A3GWitJEBg-REGxREsQiKm3VmGsXod-CNXKZOFMGUQQ4qeMzm2SI6yHKnCjQgq2hgwDXWPWc3Ofn8kg4ss4 Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Project-Id: 15fb9ccf20ec4ef2a6b64004df0061e4 Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Project-Name: tempest-VolumesActionsTest-452608968 Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/15fb9ccf20ec4ef2a6b64004df0061e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15fb9ccf20ec4ef2a6b64004df0061e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15fb9ccf20ec4ef2a6b64004df0061e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Tenant: tempest-VolumesActionsTest-452608968 Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Tenant-Id: 15fb9ccf20ec4ef2a6b64004df0061e4 Apr 14 16:15:04 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-VolumesActionsTest-452608968 Apr 14 16:15:04 user devstack@n-api.service[61874]: X-User: tempest-VolumesActionsTest-452608968-project-member Apr 14 16:15:04 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:15:04 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:15:04 user devstack@n-api.service[61874]: X-User-Id: 6061fcff5317445cab3a8da6f24d9ba4 Apr 14 16:15:04 user devstack@n-api.service[61874]: X-User-Name: tempest-VolumesActionsTest-452608968-project-member Apr 14 16:15:04 user devstack@n-api.service[61874]: method: > Apr 14 16:15:04 user devstack@n-api.service[61874]: exception: Instance f5355a43-4e93-484e-87ad-6e179c8821c2 could not be found. Apr 14 16:15:04 user devstack@n-api.service[61874]: action_args: {'id': 'f5355a43-4e93-484e-87ad-6e179c8821c2'} Apr 14 16:15:04 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5355a43-4e93-484e-87ad-6e179c8821c2 could not be found. Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5355a43-4e93-484e-87ad-6e179c8821c2 could not be found. Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5355a43-4e93-484e-87ad-6e179c8821c2 could not be found. Apr 14 16:15:04 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:15:04 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2d0099c4-a760-489b-9913-206ab93ceb1c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Returning 404 to user: Instance f5355a43-4e93-484e-87ad-6e179c8821c2 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:15:04 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-2d0099c4-a760-489b-9913-206ab93ceb1c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5355a43-4e93-484e-87ad-6e179c8821c2" status: 404 len: 111 microversion: 2.1 time: 0.036287 Apr 14 16:15:04 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 351/1056] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:15:04 2023] GET /compute/v2.1/servers/f5355a43-4e93-484e-87ad-6e179c8821c2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:15:04 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1794843664", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34"}]}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:04 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=10 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:15:04 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=14 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:15:04 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] validate_networks() for [('69b009a5-c526-4ef9-9ba2-ad9c03e24e34', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Getting quotas for project 15fb9ccf20ec4ef2a6b64004df0061e4. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Getting quotas for user 6061fcff5317445cab3a8da6f24d9ba4 and project 15fb9ccf20ec4ef2a6b64004df0061e4. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:15:05 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:15:05 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.675552 Apr 14 16:15:05 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 354/1057] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:15:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:15:05 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-d3365db1-7385-4609-8098-f1161a7a97ef tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:15:05 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d3365db1-7385-4609-8098-f1161a7a97ef tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:15:05 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:15:05 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:15:05 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-d3365db1-7385-4609-8098-f1161a7a97ef tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6061fcff5317445cab3a8da6f24d9ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fb9ccf20ec4ef2a6b64004df0061e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:15:05 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-d3365db1-7385-4609-8098-f1161a7a97ef tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] 10.0.0.210 "GET /compute/v2.1/servers/caa3fcc9-1f1f-4983-adcd-bd005dd1691e" status: 200 len: 1208 microversion: 2.1 time: 0.308328 Apr 14 16:15:05 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 353/1058] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:15:05 2023] GET /compute/v2.1/servers/caa3fcc9-1f1f-4983-adcd-bd005dd1691e => generated 1208 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa3fcc9-1f1f-4983-adcd-bd005dd1691e", "tag": "1e22337c-e160-4d43-a04d-5195c921531a"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:08 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] Creating event network-changed:1e22337c-e160-4d43-a04d-5195c921531a for instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e on user Apr 14 16:15:08 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081856 Apr 14 16:15:08 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 352/1059] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:15:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:15:09 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-b912c25e-223f-4f24-a0bc-e421d5da5429 req-398a3559-1629-4ae7-b980-9bd0145b1974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa3fcc9-1f1f-4983-adcd-bd005dd1691e", "name": "network-vif-plugged", "status": "completed", "tag": "1e22337c-e160-4d43-a04d-5195c921531a"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b912c25e-223f-4f24-a0bc-e421d5da5429 req-398a3559-1629-4ae7-b980-9bd0145b1974 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b912c25e-223f-4f24-a0bc-e421d5da5429 req-398a3559-1629-4ae7-b980-9bd0145b1974 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b912c25e-223f-4f24-a0bc-e421d5da5429 req-398a3559-1629-4ae7-b980-9bd0145b1974 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:09 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-b912c25e-223f-4f24-a0bc-e421d5da5429 req-398a3559-1629-4ae7-b980-9bd0145b1974 service nova] Creating event network-vif-plugged:1e22337c-e160-4d43-a04d-5195c921531a for instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e on user Apr 14 16:15:09 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-b912c25e-223f-4f24-a0bc-e421d5da5429 req-398a3559-1629-4ae7-b980-9bd0145b1974 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030811 Apr 14 16:15:09 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 355/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:15:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:15:11 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-825432f9-06af-4f67-a466-64241abc2e3e req-64d8ccae-3aa7-472c-9916-41b17c934709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa3fcc9-1f1f-4983-adcd-bd005dd1691e", "name": "network-vif-plugged", "status": "completed", "tag": "1e22337c-e160-4d43-a04d-5195c921531a"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-825432f9-06af-4f67-a466-64241abc2e3e req-64d8ccae-3aa7-472c-9916-41b17c934709 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-825432f9-06af-4f67-a466-64241abc2e3e req-64d8ccae-3aa7-472c-9916-41b17c934709 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-825432f9-06af-4f67-a466-64241abc2e3e req-64d8ccae-3aa7-472c-9916-41b17c934709 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:11 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-825432f9-06af-4f67-a466-64241abc2e3e req-64d8ccae-3aa7-472c-9916-41b17c934709 service nova] Creating event network-vif-plugged:1e22337c-e160-4d43-a04d-5195c921531a for instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e on user Apr 14 16:15:12 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-825432f9-06af-4f67-a466-64241abc2e3e req-64d8ccae-3aa7-472c-9916-41b17c934709 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031062 Apr 14 16:15:12 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 354/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:15:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:15:19 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:15:19 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:15:19 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-6e0c58e2-1302-4189-8f8b-05920a4f31dc tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:15:19 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-6e0c58e2-1302-4189-8f8b-05920a4f31dc tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:15:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6e0c58e2-1302-4189-8f8b-05920a4f31dc tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6e0c58e2-1302-4189-8f8b-05920a4f31dc tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6e0c58e2-1302-4189-8f8b-05920a4f31dc tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6e0c58e2-1302-4189-8f8b-05920a4f31dc tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6e0c58e2-1302-4189-8f8b-05920a4f31dc tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:19 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-6e0c58e2-1302-4189-8f8b-05920a4f31dc tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:19 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-6e0c58e2-1302-4189-8f8b-05920a4f31dc tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:15:19 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-6e0c58e2-1302-4189-8f8b-05920a4f31dc tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a" status: 200 len: 1379 microversion: 2.1 time: 0.476733 Apr 14 16:15:19 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 353/1062] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:15:18 2023] GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a => generated 1379 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:19 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-e95232f0-1b8d-4a89-a633-6e4eb4530322 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:15:19 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-e95232f0-1b8d-4a89-a633-6e4eb4530322 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:15:19 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:15:19 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:15:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e95232f0-1b8d-4a89-a633-6e4eb4530322 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e95232f0-1b8d-4a89-a633-6e4eb4530322 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e95232f0-1b8d-4a89-a633-6e4eb4530322 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e95232f0-1b8d-4a89-a633-6e4eb4530322 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e95232f0-1b8d-4a89-a633-6e4eb4530322 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:19 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e95232f0-1b8d-4a89-a633-6e4eb4530322 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:19 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-e95232f0-1b8d-4a89-a633-6e4eb4530322 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:15:19 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-e95232f0-1b8d-4a89-a633-6e4eb4530322 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a" status: 200 len: 1379 microversion: 2.1 time: 0.339437 Apr 14 16:15:19 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 356/1063] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:15:19 2023] GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a => generated 1379 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:19 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:15:19 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:15:19 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:15:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:19 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:15:20 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a" status: 204 len: 0 microversion: 2.1 time: 0.216518 Apr 14 16:15:20 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 355/1064] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:15:19 2023] DELETE /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:15:20 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-3c3157e1-2e2d-4556-b141-9bbf59344276 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:15:20 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-3c3157e1-2e2d-4556-b141-9bbf59344276 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:15:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3c3157e1-2e2d-4556-b141-9bbf59344276 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3c3157e1-2e2d-4556-b141-9bbf59344276 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3c3157e1-2e2d-4556-b141-9bbf59344276 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3c3157e1-2e2d-4556-b141-9bbf59344276 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3c3157e1-2e2d-4556-b141-9bbf59344276 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:20 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-3c3157e1-2e2d-4556-b141-9bbf59344276 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:20 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-3c3157e1-2e2d-4556-b141-9bbf59344276 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:15:20 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-3c3157e1-2e2d-4556-b141-9bbf59344276 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a" status: 200 len: 1385 microversion: 2.1 time: 0.221609 Apr 14 16:15:20 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 354/1065] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:15:20 2023] GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a => generated 1385 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:15:20 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-7cc6c2e5-a8de-468e-ba0e-d39d6192a030 req-1d04d5f8-8dac-42a0-982e-8c2facf6e118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54af8caf-09fa-4ada-b446-91e43876581a", "name": "network-vif-unplugged", "status": "completed", "tag": "b31de579-1646-47cd-a9d8-9e45df05addf"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-7cc6c2e5-a8de-468e-ba0e-d39d6192a030 req-1d04d5f8-8dac-42a0-982e-8c2facf6e118 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-7cc6c2e5-a8de-468e-ba0e-d39d6192a030 req-1d04d5f8-8dac-42a0-982e-8c2facf6e118 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:20 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-7cc6c2e5-a8de-468e-ba0e-d39d6192a030 req-1d04d5f8-8dac-42a0-982e-8c2facf6e118 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:20 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-7cc6c2e5-a8de-468e-ba0e-d39d6192a030 req-1d04d5f8-8dac-42a0-982e-8c2facf6e118 service nova] Creating event network-vif-unplugged:b31de579-1646-47cd-a9d8-9e45df05addf for instance 54af8caf-09fa-4ada-b446-91e43876581a on user Apr 14 16:15:20 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-7cc6c2e5-a8de-468e-ba0e-d39d6192a030 req-1d04d5f8-8dac-42a0-982e-8c2facf6e118 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043386 Apr 14 16:15:20 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 357/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:15:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:15:22 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54af8caf-09fa-4ada-b446-91e43876581a", "name": "network-vif-plugged", "status": "completed", "tag": "b31de579-1646-47cd-a9d8-9e45df05addf"}, {"server_uuid": "54af8caf-09fa-4ada-b446-91e43876581a", "name": "network-vif-deleted", "tag": "b31de579-1646-47cd-a9d8-9e45df05addf"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:15:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:22 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:22 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] Creating event network-vif-plugged:b31de579-1646-47cd-a9d8-9e45df05addf for instance 54af8caf-09fa-4ada-b446-91e43876581a on user Apr 14 16:15:22 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] Creating event network-vif-deleted:b31de579-1646-47cd-a9d8-9e45df05addf for instance 54af8caf-09fa-4ada-b446-91e43876581a on user Apr 14 16:15:22 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044889 Apr 14 16:15:22 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 356/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:15:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:15:55 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-b256c227-e07f-49b2-a3cd-5c61e58650e7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:15:55 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-b256c227-e07f-49b2-a3cd-5c61e58650e7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:15:55 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:15:55 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=12 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:15:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b256c227-e07f-49b2-a3cd-5c61e58650e7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b256c227-e07f-49b2-a3cd-5c61e58650e7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b256c227-e07f-49b2-a3cd-5c61e58650e7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b256c227-e07f-49b2-a3cd-5c61e58650e7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:15:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b256c227-e07f-49b2-a3cd-5c61e58650e7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:15:55 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-b256c227-e07f-49b2-a3cd-5c61e58650e7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:15:55 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-b256c227-e07f-49b2-a3cd-5c61e58650e7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6061fcff5317445cab3a8da6f24d9ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fb9ccf20ec4ef2a6b64004df0061e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:15:55 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-b256c227-e07f-49b2-a3cd-5c61e58650e7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] 10.0.0.210 "GET /compute/v2.1/servers/caa3fcc9-1f1f-4983-adcd-bd005dd1691e" status: 200 len: 1484 microversion: 2.1 time: 0.227296 Apr 14 16:15:55 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 355/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:15:55 2023] GET /compute/v2.1/servers/caa3fcc9-1f1f-4983-adcd-bd005dd1691e => generated 1484 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:10 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:10 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=12 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:10 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-636a1e6a-08c3-463e-9c2a-45f38b32c42c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:16:10 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-636a1e6a-08c3-463e-9c2a-45f38b32c42c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:16:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-636a1e6a-08c3-463e-9c2a-45f38b32c42c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-636a1e6a-08c3-463e-9c2a-45f38b32c42c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-636a1e6a-08c3-463e-9c2a-45f38b32c42c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-636a1e6a-08c3-463e-9c2a-45f38b32c42c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-636a1e6a-08c3-463e-9c2a-45f38b32c42c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:10 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-636a1e6a-08c3-463e-9c2a-45f38b32c42c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-636a1e6a-08c3-463e-9c2a-45f38b32c42c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-636a1e6a-08c3-463e-9c2a-45f38b32c42c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:16:10 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a HTTP/1.1 Apr 14 16:16:10 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:16:10 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:16:10 user devstack@n-api.service[61876]: Connection: close Apr 14 16:16:10 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:16:10 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:16:10 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:16:10 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:16:10 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:16:10 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:16:10 user devstack@n-api.service[61876]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:16:10 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:16:10 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:16:10 user devstack@n-api.service[61876]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:16:10 user devstack@n-api.service[61876]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:16:10 user devstack@n-api.service[61876]: method: > Apr 14 16:16:10 user devstack@n-api.service[61876]: exception: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61876]: action_args: {'id': '54af8caf-09fa-4ada-b446-91e43876581a'} Apr 14 16:16:10 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-636a1e6a-08c3-463e-9c2a-45f38b32c42c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:16:10 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-636a1e6a-08c3-463e-9c2a-45f38b32c42c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a" status: 404 len: 111 microversion: 2.1 time: 0.036077 Apr 14 16:16:10 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 358/1069] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:16:10 2023] GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:16:10 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:10 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:10 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-cdf39bd5-da03-4f49-93d9-91a275b62400 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:16:10 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-cdf39bd5-da03-4f49-93d9-91a275b62400 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:16:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cdf39bd5-da03-4f49-93d9-91a275b62400 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cdf39bd5-da03-4f49-93d9-91a275b62400 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cdf39bd5-da03-4f49-93d9-91a275b62400 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cdf39bd5-da03-4f49-93d9-91a275b62400 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cdf39bd5-da03-4f49-93d9-91a275b62400 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:10 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-cdf39bd5-da03-4f49-93d9-91a275b62400 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:10 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-cdf39bd5-da03-4f49-93d9-91a275b62400 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-cdf39bd5-da03-4f49-93d9-91a275b62400 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:16:10 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a HTTP/1.1 Apr 14 16:16:10 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:16:10 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:16:10 user devstack@n-api.service[61875]: Connection: close Apr 14 16:16:10 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:16:10 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:16:10 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:16:10 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:16:10 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:16:10 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:16:10 user devstack@n-api.service[61875]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:16:10 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:16:10 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:16:10 user devstack@n-api.service[61875]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:16:10 user devstack@n-api.service[61875]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:16:10 user devstack@n-api.service[61875]: method: > Apr 14 16:16:10 user devstack@n-api.service[61875]: exception: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61875]: action_args: {'id': '54af8caf-09fa-4ada-b446-91e43876581a'} Apr 14 16:16:10 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-cdf39bd5-da03-4f49-93d9-91a275b62400 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:16:10 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-cdf39bd5-da03-4f49-93d9-91a275b62400 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a" status: 404 len: 111 microversion: 2.1 time: 0.053461 Apr 14 16:16:10 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 357/1070] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:16:10 2023] DELETE /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:16:10 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-fc4b3e3b-1006-4827-983e-60adbdbb0f08 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:16:10 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-fc4b3e3b-1006-4827-983e-60adbdbb0f08 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:16:10 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:10 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fc4b3e3b-1006-4827-983e-60adbdbb0f08 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fc4b3e3b-1006-4827-983e-60adbdbb0f08 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fc4b3e3b-1006-4827-983e-60adbdbb0f08 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fc4b3e3b-1006-4827-983e-60adbdbb0f08 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fc4b3e3b-1006-4827-983e-60adbdbb0f08 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fc4b3e3b-1006-4827-983e-60adbdbb0f08 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:10 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-fc4b3e3b-1006-4827-983e-60adbdbb0f08 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-fc4b3e3b-1006-4827-983e-60adbdbb0f08 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:16:10 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a HTTP/1.1 Apr 14 16:16:10 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:16:10 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:16:10 user devstack@n-api.service[61874]: Connection: close Apr 14 16:16:10 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:16:10 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:16:10 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:16:10 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:16:10 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:16:10 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:16:10 user devstack@n-api.service[61874]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:16:10 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:16:10 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:16:10 user devstack@n-api.service[61874]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:16:10 user devstack@n-api.service[61874]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:16:10 user devstack@n-api.service[61874]: method: > Apr 14 16:16:10 user devstack@n-api.service[61874]: exception: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61874]: action_args: {'id': '54af8caf-09fa-4ada-b446-91e43876581a'} Apr 14 16:16:10 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. Apr 14 16:16:10 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:16:10 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-fc4b3e3b-1006-4827-983e-60adbdbb0f08 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance 54af8caf-09fa-4ada-b446-91e43876581a could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:16:10 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-fc4b3e3b-1006-4827-983e-60adbdbb0f08 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a" status: 404 len: 111 microversion: 2.1 time: 0.029151 Apr 14 16:16:10 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 356/1071] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:16:10 2023] GET /compute/v2.1/servers/54af8caf-09fa-4ada-b446-91e43876581a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:16:20 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-345674687", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "ded1e85d-494f-490d-9ddc-7d7b9bc8c020", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "43ce94ae-5ff4-4006-b800-67d1f29a9898"}]}} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:20 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:20 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:20 user devstack@n-api.service[61876]: DEBUG nova.network.neutron [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] validate_networks() for [('43ce94ae-5ff4-4006-b800-67d1f29a9898', None, None, None, None, None)] {{(pid=61876) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image limits 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image pref 0:0:0 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG nova.quota [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for user bb3b7ae19e044c3e90292751dd633279 and project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Going to run 1 instances... {{(pid=61876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:16:21 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ded1e85d-494f-490d-9ddc-7d7b9bc8c020',volume_size=None,volume_type=None)] {{(pid=61876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:16:21 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.714919 Apr 14 16:16:21 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 359/1072] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:16:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:16:21 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-0299be0f-4c93-495c-a5c9-577d8052786b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:16:21 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-0299be0f-4c93-495c-a5c9-577d8052786b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:16:21 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:21 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:21 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-0299be0f-4c93-495c-a5c9-577d8052786b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:16:21 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-0299be0f-4c93-495c-a5c9-577d8052786b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122" status: 200 len: 1065 microversion: 2.1 time: 0.077027 Apr 14 16:16:21 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 358/1073] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:16:21 2023] GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122 => generated 1065 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:23 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375e1073-5299-4d9d-8100-6f626e4bf122", "tag": "c83d0ffe-900d-4f39-bd31-2db21e0870f7"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:23 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:23 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:23 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:23 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] Creating event network-changed:c83d0ffe-900d-4f39-bd31-2db21e0870f7 for instance 375e1073-5299-4d9d-8100-6f626e4bf122 on user Apr 14 16:16:23 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036205 Apr 14 16:16:23 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 357/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:16:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:16:30 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-b07a8a2a-93d0-454b-884f-5fd25e87698f req-f827e2db-319e-412a-86b9-52dba22f74d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375e1073-5299-4d9d-8100-6f626e4bf122", "name": "network-vif-plugged", "status": "completed", "tag": "c83d0ffe-900d-4f39-bd31-2db21e0870f7"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b07a8a2a-93d0-454b-884f-5fd25e87698f req-f827e2db-319e-412a-86b9-52dba22f74d7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b07a8a2a-93d0-454b-884f-5fd25e87698f req-f827e2db-319e-412a-86b9-52dba22f74d7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:30 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b07a8a2a-93d0-454b-884f-5fd25e87698f req-f827e2db-319e-412a-86b9-52dba22f74d7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:30 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-b07a8a2a-93d0-454b-884f-5fd25e87698f req-f827e2db-319e-412a-86b9-52dba22f74d7 service nova] Creating event network-vif-plugged:c83d0ffe-900d-4f39-bd31-2db21e0870f7 for instance 375e1073-5299-4d9d-8100-6f626e4bf122 on user Apr 14 16:16:30 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-b07a8a2a-93d0-454b-884f-5fd25e87698f req-f827e2db-319e-412a-86b9-52dba22f74d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042149 Apr 14 16:16:30 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 360/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:16:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:16:32 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-51202d69-085e-4ed7-8fcb-b8013b6de2d9 req-3531e499-eebc-4f97-9172-e90e78dc6e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375e1073-5299-4d9d-8100-6f626e4bf122", "name": "network-vif-plugged", "status": "completed", "tag": "c83d0ffe-900d-4f39-bd31-2db21e0870f7"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:32 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:32 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-51202d69-085e-4ed7-8fcb-b8013b6de2d9 req-3531e499-eebc-4f97-9172-e90e78dc6e62 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-51202d69-085e-4ed7-8fcb-b8013b6de2d9 req-3531e499-eebc-4f97-9172-e90e78dc6e62 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:32 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-51202d69-085e-4ed7-8fcb-b8013b6de2d9 req-3531e499-eebc-4f97-9172-e90e78dc6e62 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-51202d69-085e-4ed7-8fcb-b8013b6de2d9 req-3531e499-eebc-4f97-9172-e90e78dc6e62 service nova] Creating event network-vif-plugged:c83d0ffe-900d-4f39-bd31-2db21e0870f7 for instance 375e1073-5299-4d9d-8100-6f626e4bf122 on user Apr 14 16:16:32 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-51202d69-085e-4ed7-8fcb-b8013b6de2d9 req-3531e499-eebc-4f97-9172-e90e78dc6e62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039874 Apr 14 16:16:32 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 359/1076] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:16:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:16:56 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:56 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:56 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:16:56 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:16:56 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:56 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:56 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:56 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:56 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:56 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:56 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:16:56 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/caa3fcc9-1f1f-4983-adcd-bd005dd1691e" status: 204 len: 0 microversion: 2.1 time: 0.118950 Apr 14 16:16:56 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 358/1077] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:16:56 2023] DELETE /compute/v2.1/servers/caa3fcc9-1f1f-4983-adcd-bd005dd1691e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:16:56 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:56 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:56 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:56 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:56 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-5b8ded04-6463-4e3d-8bd5-6a22205f6ff6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:16:56 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-5b8ded04-6463-4e3d-8bd5-6a22205f6ff6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:16:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b8ded04-6463-4e3d-8bd5-6a22205f6ff6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b8ded04-6463-4e3d-8bd5-6a22205f6ff6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b8ded04-6463-4e3d-8bd5-6a22205f6ff6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b8ded04-6463-4e3d-8bd5-6a22205f6ff6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b8ded04-6463-4e3d-8bd5-6a22205f6ff6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-5b8ded04-6463-4e3d-8bd5-6a22205f6ff6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:56 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-5b8ded04-6463-4e3d-8bd5-6a22205f6ff6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6061fcff5317445cab3a8da6f24d9ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fb9ccf20ec4ef2a6b64004df0061e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:16:56 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-5b8ded04-6463-4e3d-8bd5-6a22205f6ff6 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] 10.0.0.210 "GET /compute/v2.1/servers/caa3fcc9-1f1f-4983-adcd-bd005dd1691e" status: 200 len: 1490 microversion: 2.1 time: 0.261855 Apr 14 16:16:56 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 361/1078] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:16:56 2023] GET /compute/v2.1/servers/caa3fcc9-1f1f-4983-adcd-bd005dd1691e => generated 1490 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:16:57 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:57 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:16:57 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-fa453e24-6b62-4145-8dc0-a5e2545b6046 req-75f3bd6f-de1a-4442-a071-5aa65f0037bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa3fcc9-1f1f-4983-adcd-bd005dd1691e", "name": "network-vif-unplugged", "status": "completed", "tag": "1e22337c-e160-4d43-a04d-5195c921531a"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:57 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fa453e24-6b62-4145-8dc0-a5e2545b6046 req-75f3bd6f-de1a-4442-a071-5aa65f0037bb service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:57 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fa453e24-6b62-4145-8dc0-a5e2545b6046 req-75f3bd6f-de1a-4442-a071-5aa65f0037bb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:57 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-fa453e24-6b62-4145-8dc0-a5e2545b6046 req-75f3bd6f-de1a-4442-a071-5aa65f0037bb service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-fa453e24-6b62-4145-8dc0-a5e2545b6046 req-75f3bd6f-de1a-4442-a071-5aa65f0037bb service nova] Creating event network-vif-unplugged:1e22337c-e160-4d43-a04d-5195c921531a for instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e on user Apr 14 16:16:57 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-fa453e24-6b62-4145-8dc0-a5e2545b6046 req-75f3bd6f-de1a-4442-a071-5aa65f0037bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039885 Apr 14 16:16:57 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 360/1079] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:16:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:16:58 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-def74e51-c1a8-40e3-9269-1c0bededa3fc req-2174b3a6-6ca4-44ad-ace3-47fa684caa44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa3fcc9-1f1f-4983-adcd-bd005dd1691e", "name": "network-vif-deleted", "tag": "1e22337c-e160-4d43-a04d-5195c921531a"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-def74e51-c1a8-40e3-9269-1c0bededa3fc req-2174b3a6-6ca4-44ad-ace3-47fa684caa44 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-def74e51-c1a8-40e3-9269-1c0bededa3fc req-2174b3a6-6ca4-44ad-ace3-47fa684caa44 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:58 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-def74e51-c1a8-40e3-9269-1c0bededa3fc req-2174b3a6-6ca4-44ad-ace3-47fa684caa44 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-def74e51-c1a8-40e3-9269-1c0bededa3fc req-2174b3a6-6ca4-44ad-ace3-47fa684caa44 service nova] Creating event network-vif-deleted:1e22337c-e160-4d43-a04d-5195c921531a for instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e on user Apr 14 16:16:58 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-def74e51-c1a8-40e3-9269-1c0bededa3fc req-2174b3a6-6ca4-44ad-ace3-47fa684caa44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027694 Apr 14 16:16:58 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 359/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:16:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:16:59 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-9d57889c-0ba6-43d7-8f02-42813fb8e1d1 req-47ad7770-29cd-432f-91c1-a39af5ecde6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa3fcc9-1f1f-4983-adcd-bd005dd1691e", "name": "network-vif-plugged", "status": "completed", "tag": "1e22337c-e160-4d43-a04d-5195c921531a"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:16:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9d57889c-0ba6-43d7-8f02-42813fb8e1d1 req-47ad7770-29cd-432f-91c1-a39af5ecde6c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:16:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9d57889c-0ba6-43d7-8f02-42813fb8e1d1 req-47ad7770-29cd-432f-91c1-a39af5ecde6c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:16:59 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9d57889c-0ba6-43d7-8f02-42813fb8e1d1 req-47ad7770-29cd-432f-91c1-a39af5ecde6c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:16:59 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-9d57889c-0ba6-43d7-8f02-42813fb8e1d1 req-47ad7770-29cd-432f-91c1-a39af5ecde6c service nova] Creating event network-vif-plugged:1e22337c-e160-4d43-a04d-5195c921531a for instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e on user Apr 14 16:16:59 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-9d57889c-0ba6-43d7-8f02-42813fb8e1d1 req-47ad7770-29cd-432f-91c1-a39af5ecde6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028954 Apr 14 16:16:59 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 362/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:16:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:17:11 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:17:11 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:17:11 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-f8992cdd-4a8a-49f8-8722-1f5c0c5fafeb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:17:11 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-f8992cdd-4a8a-49f8-8722-1f5c0c5fafeb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:17:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f8992cdd-4a8a-49f8-8722-1f5c0c5fafeb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:17:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f8992cdd-4a8a-49f8-8722-1f5c0c5fafeb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:17:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f8992cdd-4a8a-49f8-8722-1f5c0c5fafeb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:17:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f8992cdd-4a8a-49f8-8722-1f5c0c5fafeb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:17:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f8992cdd-4a8a-49f8-8722-1f5c0c5fafeb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:17:11 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-f8992cdd-4a8a-49f8-8722-1f5c0c5fafeb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:17:11 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-f8992cdd-4a8a-49f8-8722-1f5c0c5fafeb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:17:11 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-f8992cdd-4a8a-49f8-8722-1f5c0c5fafeb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122" status: 200 len: 1393 microversion: 2.1 time: 0.242201 Apr 14 16:17:11 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 361/1082] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:17:11 2023] GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122 => generated 1393 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:17:47 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:17:47 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:17:47 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-03919fe0-3cf8-4fda-a0f6-c7e699173c7c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:17:47 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-03919fe0-3cf8-4fda-a0f6-c7e699173c7c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:17:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-03919fe0-3cf8-4fda-a0f6-c7e699173c7c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:17:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-03919fe0-3cf8-4fda-a0f6-c7e699173c7c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:17:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-03919fe0-3cf8-4fda-a0f6-c7e699173c7c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:17:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-03919fe0-3cf8-4fda-a0f6-c7e699173c7c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:17:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-03919fe0-3cf8-4fda-a0f6-c7e699173c7c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:17:47 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-03919fe0-3cf8-4fda-a0f6-c7e699173c7c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:17:47 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-03919fe0-3cf8-4fda-a0f6-c7e699173c7c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] HTTP exception thrown: Instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e could not be found. Apr 14 16:17:47 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-03919fe0-3cf8-4fda-a0f6-c7e699173c7c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Request method failure captured: Apr 14 16:17:47 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/caa3fcc9-1f1f-4983-adcd-bd005dd1691e HTTP/1.1 Apr 14 16:17:47 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:17:47 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:17:47 user devstack@n-api.service[61874]: Connection: close Apr 14 16:17:47 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:17:47 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:17:47 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:17:47 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:17:47 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXtjqnrYdb91bsrIrGfJeu7fpfLw_2L_KHEOhvcvjnWC41xp6RXtUErtDDeV4FK-uBr6OcVXaQ8xvFMYPuyxhBSKu5X8A3GWitJEBg-REGxREsQiKm3VmGsXod-CNXKZOFMGUQQ4qeMzm2SI6yHKnCjQgq2hgwDXWPWc3Ofn8kg4ss4 Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Project-Id: 15fb9ccf20ec4ef2a6b64004df0061e4 Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Project-Name: tempest-VolumesActionsTest-452608968 Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/15fb9ccf20ec4ef2a6b64004df0061e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15fb9ccf20ec4ef2a6b64004df0061e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15fb9ccf20ec4ef2a6b64004df0061e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Tenant: tempest-VolumesActionsTest-452608968 Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Tenant-Id: 15fb9ccf20ec4ef2a6b64004df0061e4 Apr 14 16:17:47 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-VolumesActionsTest-452608968 Apr 14 16:17:47 user devstack@n-api.service[61874]: X-User: tempest-VolumesActionsTest-452608968-project-member Apr 14 16:17:47 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:17:47 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:17:47 user devstack@n-api.service[61874]: X-User-Id: 6061fcff5317445cab3a8da6f24d9ba4 Apr 14 16:17:47 user devstack@n-api.service[61874]: X-User-Name: tempest-VolumesActionsTest-452608968-project-member Apr 14 16:17:47 user devstack@n-api.service[61874]: method: > Apr 14 16:17:47 user devstack@n-api.service[61874]: exception: Instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e could not be found. Apr 14 16:17:47 user devstack@n-api.service[61874]: action_args: {'id': 'caa3fcc9-1f1f-4983-adcd-bd005dd1691e'} Apr 14 16:17:47 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e could not be found. Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e could not be found. Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e could not be found. Apr 14 16:17:47 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:17:47 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-03919fe0-3cf8-4fda-a0f6-c7e699173c7c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Returning 404 to user: Instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:17:47 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-03919fe0-3cf8-4fda-a0f6-c7e699173c7c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] 10.0.0.210 "GET /compute/v2.1/servers/caa3fcc9-1f1f-4983-adcd-bd005dd1691e" status: 404 len: 111 microversion: 2.1 time: 0.299654 Apr 14 16:17:47 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 360/1083] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:17:47 2023] GET /compute/v2.1/servers/caa3fcc9-1f1f-4983-adcd-bd005dd1691e => generated 111 bytes in 301 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:18:12 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:18:12 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:18:12 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-3a0bae71-cbaa-41ac-86d4-6bd057be36bb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:18:12 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-3a0bae71-cbaa-41ac-86d4-6bd057be36bb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:18:12 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3a0bae71-cbaa-41ac-86d4-6bd057be36bb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:12 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3a0bae71-cbaa-41ac-86d4-6bd057be36bb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:12 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3a0bae71-cbaa-41ac-86d4-6bd057be36bb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:12 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3a0bae71-cbaa-41ac-86d4-6bd057be36bb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:12 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3a0bae71-cbaa-41ac-86d4-6bd057be36bb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:12 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3a0bae71-cbaa-41ac-86d4-6bd057be36bb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:12 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-3a0bae71-cbaa-41ac-86d4-6bd057be36bb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:18:12 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-3a0bae71-cbaa-41ac-86d4-6bd057be36bb tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122" status: 200 len: 1393 microversion: 2.1 time: 0.264443 Apr 14 16:18:12 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 363/1084] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:18:12 2023] GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122 => generated 1393 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:12 user devstack@n-api.service[61875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:18:12 user devstack@n-api.service[61875]: Fri Apr 14 16:18:12 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122/action (ip 10.0.0.210) !!! Apr 14 16:18:12 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:18:12 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:18:12 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-d02ba7ee-451a-40a1-89d4-8aadda0e5539 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-772270288"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:12 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d02ba7ee-451a-40a1-89d4-8aadda0e5539 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:18:12 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d02ba7ee-451a-40a1-89d4-8aadda0e5539 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:12 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d02ba7ee-451a-40a1-89d4-8aadda0e5539 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:12 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d02ba7ee-451a-40a1-89d4-8aadda0e5539 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:12 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d02ba7ee-451a-40a1-89d4-8aadda0e5539 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:12 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d02ba7ee-451a-40a1-89d4-8aadda0e5539 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:12 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d02ba7ee-451a-40a1-89d4-8aadda0e5539 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:12 user devstack@n-api.service[61875]: INFO nova.compute.api [None req-d02ba7ee-451a-40a1-89d4-8aadda0e5539 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Attempting to quiesce instance before volume snapshot. Apr 14 16:18:12 user devstack@n-api.service[61875]: INFO nova.compute.api [None req-d02ba7ee-451a-40a1-89d4-8aadda0e5539 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 14 16:18:12 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d02ba7ee-451a-40a1-89d4-8aadda0e5539 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Creating snapshot from volume ded1e85d-494f-490d-9ddc-7d7b9bc8c020. {{(pid=61875) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 14 16:18:14 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-d02ba7ee-451a-40a1-89d4-8aadda0e5539 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "POST /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122/action" status: 202 len: 0 microversion: 2.1 time: 2.625828 Apr 14 16:18:14 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 362/1085] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 16:18:12 2023] POST /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122/action => generated 0 bytes in 2627 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1337435188", "imageRef": "0e4f659b-d29c-4f4f-b2df-b08af690bed4", "flavorRef": "42", "networks": [{"uuid": "43ce94ae-5ff4-4006-b800-67d1f29a9898"}]}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] validate_networks() for [('43ce94ae-5ff4-4006-b800-67d1f29a9898', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for user bb3b7ae19e044c3e90292751dd633279 and project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:18:16 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a62f8b6c-ec93-41d6-ba1c-a02e35ac69f5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:18:16 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.684205 Apr 14 16:18:16 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 361/1086] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:18:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:18:16 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-2f82da0f-b698-498b-8701-e7f716932014 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:18:16 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-2f82da0f-b698-498b-8701-e7f716932014 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:18:16 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-2f82da0f-b698-498b-8701-e7f716932014 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:18:16 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-2f82da0f-b698-498b-8701-e7f716932014 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea" status: 200 len: 1224 microversion: 2.1 time: 0.064684 Apr 14 16:18:16 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 364/1087] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:18:16 2023] GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea => generated 1224 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:19 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f8afdbf-f148-4447-a480-dbbb17fc45ea", "tag": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:19 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:19 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] Creating event network-changed:ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 for instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea on user Apr 14 16:18:19 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036338 Apr 14 16:18:19 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 363/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:18:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1886734098", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "2873e414-99d7-4231-8560-2b553fe24429"}]}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] validate_networks() for [('2873e414-99d7-4231-8560-2b553fe24429', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Getting quotas for project e78327b280e74412bd43a54a522c20d0. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Getting quotas for user ffdaf3dc40b0445ea03d2f69abd46924 and project e78327b280e74412bd43a54a522c20d0. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:18:26 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:18:26 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.563095 Apr 14 16:18:26 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 362/1089] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:18:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:18:27 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-e7889690-a336-42ed-b4d4-df443ebd9329 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:18:27 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-e7889690-a336-42ed-b4d4-df443ebd9329 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:18:27 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:18:27 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:18:27 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:18:27 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-e7889690-a336-42ed-b4d4-df443ebd9329 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdaf3dc40b0445ea03d2f69abd46924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78327b280e74412bd43a54a522c20d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:18:27 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-e7889690-a336-42ed-b4d4-df443ebd9329 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a" status: 200 len: 1213 microversion: 2.1 time: 0.076291 Apr 14 16:18:27 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 365/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:18:26 2023] GET /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:18:29 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0b5baa-3cec-4162-b27e-fa2665134f2a", "tag": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:29 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:29 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] Creating event network-changed:45b6be70-59dc-4cbe-a5c9-9a6feab419cf for instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a on user Apr 14 16:18:29 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034334 Apr 14 16:18:29 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 364/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:18:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:32 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-16b27579-d0e2-40be-bf2a-5eb6f163296c req-d9e2ab4e-d58b-4bec-be3b-a73c359141e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0b5baa-3cec-4162-b27e-fa2665134f2a", "name": "network-vif-plugged", "status": "completed", "tag": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-16b27579-d0e2-40be-bf2a-5eb6f163296c req-d9e2ab4e-d58b-4bec-be3b-a73c359141e1 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-16b27579-d0e2-40be-bf2a-5eb6f163296c req-d9e2ab4e-d58b-4bec-be3b-a73c359141e1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:32 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-16b27579-d0e2-40be-bf2a-5eb6f163296c req-d9e2ab4e-d58b-4bec-be3b-a73c359141e1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:32 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-16b27579-d0e2-40be-bf2a-5eb6f163296c req-d9e2ab4e-d58b-4bec-be3b-a73c359141e1 service nova] Creating event network-vif-plugged:45b6be70-59dc-4cbe-a5c9-9a6feab419cf for instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a on user Apr 14 16:18:32 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-16b27579-d0e2-40be-bf2a-5eb6f163296c req-d9e2ab4e-d58b-4bec-be3b-a73c359141e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032544 Apr 14 16:18:32 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 363/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:18:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:32 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-32f21d0a-44c4-4bb1-a7a4-33dc1fa81bba req-2f2a6747-2f4e-467c-ae82-8ab8bd63dc45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8afdbf-f148-4447-a480-dbbb17fc45ea", "name": "network-vif-plugged", "status": "completed", "tag": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-32f21d0a-44c4-4bb1-a7a4-33dc1fa81bba req-2f2a6747-2f4e-467c-ae82-8ab8bd63dc45 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-32f21d0a-44c4-4bb1-a7a4-33dc1fa81bba req-2f2a6747-2f4e-467c-ae82-8ab8bd63dc45 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:32 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-32f21d0a-44c4-4bb1-a7a4-33dc1fa81bba req-2f2a6747-2f4e-467c-ae82-8ab8bd63dc45 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:32 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-32f21d0a-44c4-4bb1-a7a4-33dc1fa81bba req-2f2a6747-2f4e-467c-ae82-8ab8bd63dc45 service nova] Creating event network-vif-plugged:ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 for instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea on user Apr 14 16:18:32 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-32f21d0a-44c4-4bb1-a7a4-33dc1fa81bba req-2f2a6747-2f4e-467c-ae82-8ab8bd63dc45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181505 Apr 14 16:18:32 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 366/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:18:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:18:34 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-48663320-50a2-400b-a3c4-d5b4c029068d req-76ad0e5b-a2e6-470c-ae8f-8e9ef9cdb37b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0b5baa-3cec-4162-b27e-fa2665134f2a", "name": "network-vif-plugged", "status": "completed", "tag": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-48663320-50a2-400b-a3c4-d5b4c029068d req-76ad0e5b-a2e6-470c-ae8f-8e9ef9cdb37b service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-48663320-50a2-400b-a3c4-d5b4c029068d req-76ad0e5b-a2e6-470c-ae8f-8e9ef9cdb37b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-48663320-50a2-400b-a3c4-d5b4c029068d req-76ad0e5b-a2e6-470c-ae8f-8e9ef9cdb37b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:34 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-48663320-50a2-400b-a3c4-d5b4c029068d req-76ad0e5b-a2e6-470c-ae8f-8e9ef9cdb37b service nova] Creating event network-vif-plugged:45b6be70-59dc-4cbe-a5c9-9a6feab419cf for instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a on user Apr 14 16:18:34 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-48663320-50a2-400b-a3c4-d5b4c029068d req-76ad0e5b-a2e6-470c-ae8f-8e9ef9cdb37b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030198 Apr 14 16:18:34 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 365/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:18:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:18:34 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-7cb895dd-5650-4e86-9f2a-a54eb40b8c68 req-a06e80ed-2a5e-4de1-8055-7a807db2f9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8afdbf-f148-4447-a480-dbbb17fc45ea", "name": "network-vif-plugged", "status": "completed", "tag": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:18:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-7cb895dd-5650-4e86-9f2a-a54eb40b8c68 req-a06e80ed-2a5e-4de1-8055-7a807db2f9ac service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:18:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-7cb895dd-5650-4e86-9f2a-a54eb40b8c68 req-a06e80ed-2a5e-4de1-8055-7a807db2f9ac service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:18:34 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-7cb895dd-5650-4e86-9f2a-a54eb40b8c68 req-a06e80ed-2a5e-4de1-8055-7a807db2f9ac service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:18:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-7cb895dd-5650-4e86-9f2a-a54eb40b8c68 req-a06e80ed-2a5e-4de1-8055-7a807db2f9ac service nova] Creating event network-vif-plugged:ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 for instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea on user Apr 14 16:18:34 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-7cb895dd-5650-4e86-9f2a-a54eb40b8c68 req-a06e80ed-2a5e-4de1-8055-7a807db2f9ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039836 Apr 14 16:18:34 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 364/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:18:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:19:06 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:19:06 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:19:06 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:19:06 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-504d52d1-56fd-4ef6-9256-d443c0da6380 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:19:06 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-504d52d1-56fd-4ef6-9256-d443c0da6380 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:19:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-504d52d1-56fd-4ef6-9256-d443c0da6380 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:19:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-504d52d1-56fd-4ef6-9256-d443c0da6380 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:19:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-504d52d1-56fd-4ef6-9256-d443c0da6380 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:19:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-504d52d1-56fd-4ef6-9256-d443c0da6380 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:19:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-504d52d1-56fd-4ef6-9256-d443c0da6380 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:19:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-504d52d1-56fd-4ef6-9256-d443c0da6380 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:19:07 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-504d52d1-56fd-4ef6-9256-d443c0da6380 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:19:07 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-504d52d1-56fd-4ef6-9256-d443c0da6380 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea" status: 200 len: 1551 microversion: 2.1 time: 0.234082 Apr 14 16:19:07 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 367/1096] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:19:06 2023] GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea => generated 1551 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:19:17 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=8 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:19:17 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:19:17 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-196471b6-7d66-4352-8bf7-9dcda91c16e4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:19:17 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-196471b6-7d66-4352-8bf7-9dcda91c16e4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:19:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-196471b6-7d66-4352-8bf7-9dcda91c16e4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:19:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-196471b6-7d66-4352-8bf7-9dcda91c16e4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:19:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-196471b6-7d66-4352-8bf7-9dcda91c16e4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:19:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-196471b6-7d66-4352-8bf7-9dcda91c16e4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:19:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-196471b6-7d66-4352-8bf7-9dcda91c16e4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:19:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-196471b6-7d66-4352-8bf7-9dcda91c16e4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:19:17 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-196471b6-7d66-4352-8bf7-9dcda91c16e4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdaf3dc40b0445ea03d2f69abd46924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78327b280e74412bd43a54a522c20d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:19:17 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-196471b6-7d66-4352-8bf7-9dcda91c16e4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a" status: 200 len: 1496 microversion: 2.1 time: 0.247591 Apr 14 16:19:17 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 366/1097] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:19:17 2023] GET /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a => generated 1496 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-fed66ee1-bbbf-4e55-a814-ff2f26fce1bd tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-fed66ee1-bbbf-4e55-a814-ff2f26fce1bd tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fed66ee1-bbbf-4e55-a814-ff2f26fce1bd tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fed66ee1-bbbf-4e55-a814-ff2f26fce1bd tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fed66ee1-bbbf-4e55-a814-ff2f26fce1bd tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fed66ee1-bbbf-4e55-a814-ff2f26fce1bd tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fed66ee1-bbbf-4e55-a814-ff2f26fce1bd tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-fed66ee1-bbbf-4e55-a814-ff2f26fce1bd tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-fed66ee1-bbbf-4e55-a814-ff2f26fce1bd tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:20:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-fed66ee1-bbbf-4e55-a814-ff2f26fce1bd tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea" status: 200 len: 1551 microversion: 2.1 time: 0.258943 Apr 14 16:20:07 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 365/1098] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:20:07 2023] GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea => generated 1551 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:07 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:07 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:07 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:20:07 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:20:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:07 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:07 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Going to try to terminate instance {{(pid=61876) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:20:07 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea" status: 204 len: 0 microversion: 2.1 time: 0.124317 Apr 14 16:20:07 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 368/1099] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:20:07 2023] DELETE /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:20:07 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-fa535860-83ad-475f-82fb-38d7c18a78ad tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:20:07 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-fa535860-83ad-475f-82fb-38d7c18a78ad tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:20:07 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:07 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fa535860-83ad-475f-82fb-38d7c18a78ad tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fa535860-83ad-475f-82fb-38d7c18a78ad tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fa535860-83ad-475f-82fb-38d7c18a78ad tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fa535860-83ad-475f-82fb-38d7c18a78ad tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fa535860-83ad-475f-82fb-38d7c18a78ad tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-fa535860-83ad-475f-82fb-38d7c18a78ad tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-8ce90ea2-0125-4698-854d-742d57f8cbf2 req-90cc1f1b-531d-4256-93b0-c213fd4ef12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8afdbf-f148-4447-a480-dbbb17fc45ea", "name": "network-vif-unplugged", "status": "completed", "tag": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-8ce90ea2-0125-4698-854d-742d57f8cbf2 req-90cc1f1b-531d-4256-93b0-c213fd4ef12c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-8ce90ea2-0125-4698-854d-742d57f8cbf2 req-90cc1f1b-531d-4256-93b0-c213fd4ef12c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-8ce90ea2-0125-4698-854d-742d57f8cbf2 req-90cc1f1b-531d-4256-93b0-c213fd4ef12c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-8ce90ea2-0125-4698-854d-742d57f8cbf2 req-90cc1f1b-531d-4256-93b0-c213fd4ef12c service nova] Creating event network-vif-unplugged:ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 for instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea on user Apr 14 16:20:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-8ce90ea2-0125-4698-854d-742d57f8cbf2 req-90cc1f1b-531d-4256-93b0-c213fd4ef12c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044978 Apr 14 16:20:07 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 366/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:20:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:20:08 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-fa535860-83ad-475f-82fb-38d7c18a78ad tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:20:08 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-fa535860-83ad-475f-82fb-38d7c18a78ad tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea" status: 200 len: 1557 microversion: 2.1 time: 0.825998 Apr 14 16:20:08 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 367/1101] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:20:07 2023] GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea => generated 1557 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:09 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-9802c4db-29cb-4526-8b60-388743fce42d req-c0ac85eb-acce-428b-8678-4e80557f8bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8afdbf-f148-4447-a480-dbbb17fc45ea", "name": "network-vif-deleted", "tag": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:20:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9802c4db-29cb-4526-8b60-388743fce42d req-c0ac85eb-acce-428b-8678-4e80557f8bb0 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9802c4db-29cb-4526-8b60-388743fce42d req-c0ac85eb-acce-428b-8678-4e80557f8bb0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:09 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-9802c4db-29cb-4526-8b60-388743fce42d req-c0ac85eb-acce-428b-8678-4e80557f8bb0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:09 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-9802c4db-29cb-4526-8b60-388743fce42d req-c0ac85eb-acce-428b-8678-4e80557f8bb0 service nova] Creating event network-vif-deleted:ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 for instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea on user Apr 14 16:20:09 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-9802c4db-29cb-4526-8b60-388743fce42d req-c0ac85eb-acce-428b-8678-4e80557f8bb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087809 Apr 14 16:20:09 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 369/1102] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:20:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:20:09 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-f0cf1024-95a0-4586-a7be-a0ec0bb8af17 req-d51036b6-2bc6-4abf-97fb-0765e46c324c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8afdbf-f148-4447-a480-dbbb17fc45ea", "name": "network-vif-plugged", "status": "completed", "tag": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:20:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f0cf1024-95a0-4586-a7be-a0ec0bb8af17 req-d51036b6-2bc6-4abf-97fb-0765e46c324c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f0cf1024-95a0-4586-a7be-a0ec0bb8af17 req-d51036b6-2bc6-4abf-97fb-0765e46c324c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:09 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f0cf1024-95a0-4586-a7be-a0ec0bb8af17 req-d51036b6-2bc6-4abf-97fb-0765e46c324c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:10 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-f0cf1024-95a0-4586-a7be-a0ec0bb8af17 req-d51036b6-2bc6-4abf-97fb-0765e46c324c service nova] Creating event network-vif-plugged:ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 for instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea on user Apr 14 16:20:10 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-f0cf1024-95a0-4586-a7be-a0ec0bb8af17 req-d51036b6-2bc6-4abf-97fb-0765e46c324c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039174 Apr 14 16:20:10 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 367/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:20:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:20:17 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eeb99511-2a0c-4628-91f6-22da52882de4", "device": "/dev/vdb"}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:20:17 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:20:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:17 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:17 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274279 Apr 14 16:20:17 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 368/1104] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 16:20:17 2023] POST /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:20:44 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:44 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:44 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:20:44 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:20:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:44 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:44 user devstack@n-api.service[61876]: DEBUG nova.objects.instance [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'services' on Instance uuid 7d0b5baa-3cec-4162-b27e-fa2665134f2a {{(pid=61876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 16:20:45 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a/os-volume_attachments/eeb99511-2a0c-4628-91f6-22da52882de4" status: 202 len: 0 microversion: 2.1 time: 0.188752 Apr 14 16:20:45 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 370/1105] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 16:20:44 2023] DELETE /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a/os-volume_attachments/eeb99511-2a0c-4628-91f6-22da52882de4 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:20:45 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:45 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=10 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:45 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:20:45 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:20:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:45 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:45 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:20:45 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a" status: 204 len: 0 microversion: 2.1 time: 0.126893 Apr 14 16:20:45 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 368/1106] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:20:45 2023] DELETE /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:20:45 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-ac282b1f-cc79-40a4-8ef5-ff656745ef32 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:20:45 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-ac282b1f-cc79-40a4-8ef5-ff656745ef32 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:20:45 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:45 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ac282b1f-cc79-40a4-8ef5-ff656745ef32 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ac282b1f-cc79-40a4-8ef5-ff656745ef32 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ac282b1f-cc79-40a4-8ef5-ff656745ef32 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ac282b1f-cc79-40a4-8ef5-ff656745ef32 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ac282b1f-cc79-40a4-8ef5-ff656745ef32 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-ac282b1f-cc79-40a4-8ef5-ff656745ef32 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:45 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-ac282b1f-cc79-40a4-8ef5-ff656745ef32 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdaf3dc40b0445ea03d2f69abd46924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78327b280e74412bd43a54a522c20d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:20:45 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-ac282b1f-cc79-40a4-8ef5-ff656745ef32 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a" status: 200 len: 1548 microversion: 2.1 time: 0.236307 Apr 14 16:20:45 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 369/1107] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:20:45 2023] GET /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a => generated 1548 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:20:46 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-3af652ae-997b-4811-8d83-87cc5196a86f req-afa240af-4325-45cb-b72e-f85225cce4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0b5baa-3cec-4162-b27e-fa2665134f2a", "name": "network-vif-unplugged", "status": "completed", "tag": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:20:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-3af652ae-997b-4811-8d83-87cc5196a86f req-afa240af-4325-45cb-b72e-f85225cce4f8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-3af652ae-997b-4811-8d83-87cc5196a86f req-afa240af-4325-45cb-b72e-f85225cce4f8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:46 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-3af652ae-997b-4811-8d83-87cc5196a86f req-afa240af-4325-45cb-b72e-f85225cce4f8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:46 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-3af652ae-997b-4811-8d83-87cc5196a86f req-afa240af-4325-45cb-b72e-f85225cce4f8 service nova] Creating event network-vif-unplugged:45b6be70-59dc-4cbe-a5c9-9a6feab419cf for instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a on user Apr 14 16:20:46 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-3af652ae-997b-4811-8d83-87cc5196a86f req-afa240af-4325-45cb-b72e-f85225cce4f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031542 Apr 14 16:20:46 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 371/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:20:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:20:49 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0b5baa-3cec-4162-b27e-fa2665134f2a", "name": "network-vif-plugged", "status": "completed", "tag": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf"}, {"server_uuid": "7d0b5baa-3cec-4162-b27e-fa2665134f2a", "name": "network-vif-deleted", "tag": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:20:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:49 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] Creating event network-vif-plugged:45b6be70-59dc-4cbe-a5c9-9a6feab419cf for instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a on user Apr 14 16:20:49 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] Creating event network-vif-deleted:45b6be70-59dc-4cbe-a5c9-9a6feab419cf for instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a on user Apr 14 16:20:49 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033509 Apr 14 16:20:49 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 369/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:20:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:20:58 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-1ab4b195-3ad0-4e44-9d1d-0a76fe318ad5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:20:58 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-1ab4b195-3ad0-4e44-9d1d-0a76fe318ad5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:20:58 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:58 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:20:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ab4b195-3ad0-4e44-9d1d-0a76fe318ad5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ab4b195-3ad0-4e44-9d1d-0a76fe318ad5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ab4b195-3ad0-4e44-9d1d-0a76fe318ad5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ab4b195-3ad0-4e44-9d1d-0a76fe318ad5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:20:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ab4b195-3ad0-4e44-9d1d-0a76fe318ad5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:20:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-1ab4b195-3ad0-4e44-9d1d-0a76fe318ad5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:20:58 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-1ab4b195-3ad0-4e44-9d1d-0a76fe318ad5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:20:58 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-1ab4b195-3ad0-4e44-9d1d-0a76fe318ad5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:20:58 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea HTTP/1.1 Apr 14 16:20:58 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:20:58 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:20:58 user devstack@n-api.service[61875]: Connection: close Apr 14 16:20:58 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:20:58 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:20:58 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:20:58 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:20:58 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:20:58 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:20:58 user devstack@n-api.service[61875]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:20:58 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:20:58 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:20:58 user devstack@n-api.service[61875]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:20:58 user devstack@n-api.service[61875]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:20:58 user devstack@n-api.service[61875]: method: > Apr 14 16:20:58 user devstack@n-api.service[61875]: exception: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:20:58 user devstack@n-api.service[61875]: action_args: {'id': '8f8afdbf-f148-4447-a480-dbbb17fc45ea'} Apr 14 16:20:58 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:20:58 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:20:58 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-1ab4b195-3ad0-4e44-9d1d-0a76fe318ad5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:20:58 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-1ab4b195-3ad0-4e44-9d1d-0a76fe318ad5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea" status: 404 len: 111 microversion: 2.1 time: 0.096161 Apr 14 16:20:58 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 370/1110] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:20:58 2023] GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:21:01 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:21:01 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:21:01 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:21:01 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:21:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:01 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Going to try to terminate instance {{(pid=61876) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:21:02 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122" status: 204 len: 0 microversion: 2.1 time: 0.116836 Apr 14 16:21:02 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 372/1111] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:21:01 2023] DELETE /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:21:02 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:21:02 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:21:02 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-bcb2a540-83c5-4927-b5be-84aa2433fb46 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:21:02 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-bcb2a540-83c5-4927-b5be-84aa2433fb46 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:21:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bcb2a540-83c5-4927-b5be-84aa2433fb46 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bcb2a540-83c5-4927-b5be-84aa2433fb46 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bcb2a540-83c5-4927-b5be-84aa2433fb46 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bcb2a540-83c5-4927-b5be-84aa2433fb46 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bcb2a540-83c5-4927-b5be-84aa2433fb46 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:02 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bcb2a540-83c5-4927-b5be-84aa2433fb46 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:02 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-1947628b-a202-4a9d-a417-b851584df229 req-cb624f5c-8973-4d8d-ae81-38d142644e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375e1073-5299-4d9d-8100-6f626e4bf122", "name": "network-vif-unplugged", "status": "completed", "tag": "c83d0ffe-900d-4f39-bd31-2db21e0870f7"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1947628b-a202-4a9d-a417-b851584df229 req-cb624f5c-8973-4d8d-ae81-38d142644e10 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1947628b-a202-4a9d-a417-b851584df229 req-cb624f5c-8973-4d8d-ae81-38d142644e10 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:02 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-1947628b-a202-4a9d-a417-b851584df229 req-cb624f5c-8973-4d8d-ae81-38d142644e10 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-1947628b-a202-4a9d-a417-b851584df229 req-cb624f5c-8973-4d8d-ae81-38d142644e10 service nova] Creating event network-vif-unplugged:c83d0ffe-900d-4f39-bd31-2db21e0870f7 for instance 375e1073-5299-4d9d-8100-6f626e4bf122 on user Apr 14 16:21:02 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-1947628b-a202-4a9d-a417-b851584df229 req-cb624f5c-8973-4d8d-ae81-38d142644e10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047645 Apr 14 16:21:02 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 371/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:21:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:21:02 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-bcb2a540-83c5-4927-b5be-84aa2433fb46 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:21:02 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-bcb2a540-83c5-4927-b5be-84aa2433fb46 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122" status: 200 len: 1399 microversion: 2.1 time: 0.311894 Apr 14 16:21:02 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 370/1113] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:21:02 2023] GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122 => generated 1399 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:04 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375e1073-5299-4d9d-8100-6f626e4bf122", "name": "network-vif-plugged", "status": "completed", "tag": "c83d0ffe-900d-4f39-bd31-2db21e0870f7"}, {"server_uuid": "375e1073-5299-4d9d-8100-6f626e4bf122", "name": "network-vif-deleted", "tag": "c83d0ffe-900d-4f39-bd31-2db21e0870f7"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:04 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] Creating event network-vif-plugged:c83d0ffe-900d-4f39-bd31-2db21e0870f7 for instance 375e1073-5299-4d9d-8100-6f626e4bf122 on user Apr 14 16:21:04 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] Creating event network-vif-deleted:c83d0ffe-900d-4f39-bd31-2db21e0870f7 for instance 375e1073-5299-4d9d-8100-6f626e4bf122 on user Apr 14 16:21:04 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038370 Apr 14 16:21:04 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 373/1114] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:21:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:21:35 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-23d6571f-87e2-4d72-a82d-77bf28bf34c9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:21:35 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-23d6571f-87e2-4d72-a82d-77bf28bf34c9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:21:35 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:21:35 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:21:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-23d6571f-87e2-4d72-a82d-77bf28bf34c9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-23d6571f-87e2-4d72-a82d-77bf28bf34c9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-23d6571f-87e2-4d72-a82d-77bf28bf34c9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-23d6571f-87e2-4d72-a82d-77bf28bf34c9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-23d6571f-87e2-4d72-a82d-77bf28bf34c9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:35 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-23d6571f-87e2-4d72-a82d-77bf28bf34c9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-23d6571f-87e2-4d72-a82d-77bf28bf34c9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] HTTP exception thrown: Instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a could not be found. Apr 14 16:21:35 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-23d6571f-87e2-4d72-a82d-77bf28bf34c9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Request method failure captured: Apr 14 16:21:35 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a HTTP/1.1 Apr 14 16:21:35 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:21:35 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:21:35 user devstack@n-api.service[61875]: Connection: close Apr 14 16:21:35 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:21:35 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:21:35 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:21:35 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:21:35 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXzMEl0XaUu5b7_2bX977zZ_v3NLI6ajlmj5JfCh_msasGNjmGQa53spyDgbqSkYkrajaMvCwVOAXC9c-tgb4ewCCMiuZEJCPCe0NbXe0mmGWKocuwpx3mv8kLHcMuCxsUSdVyhQj3zFLQGnmsFsFIubcozsjmXl2Qxc9D0ZqV4CMH4 Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Project-Id: e78327b280e74412bd43a54a522c20d0 Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1091655053 Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e78327b280e74412bd43a54a522c20d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e78327b280e74412bd43a54a522c20d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e78327b280e74412bd43a54a522c20d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Tenant: tempest-VolumesSnapshotTestJSON-1091655053 Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Tenant-Id: e78327b280e74412bd43a54a522c20d0 Apr 14 16:21:35 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1091655053 Apr 14 16:21:35 user devstack@n-api.service[61875]: X-User: tempest-VolumesSnapshotTestJSON-1091655053-project-member Apr 14 16:21:35 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:21:35 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:21:35 user devstack@n-api.service[61875]: X-User-Id: ffdaf3dc40b0445ea03d2f69abd46924 Apr 14 16:21:35 user devstack@n-api.service[61875]: X-User-Name: tempest-VolumesSnapshotTestJSON-1091655053-project-member Apr 14 16:21:35 user devstack@n-api.service[61875]: method: > Apr 14 16:21:35 user devstack@n-api.service[61875]: exception: Instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a could not be found. Apr 14 16:21:35 user devstack@n-api.service[61875]: action_args: {'id': '7d0b5baa-3cec-4162-b27e-fa2665134f2a'} Apr 14 16:21:35 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a could not be found. Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a could not be found. Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a could not be found. Apr 14 16:21:35 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:21:35 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-23d6571f-87e2-4d72-a82d-77bf28bf34c9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Returning 404 to user: Instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:21:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-23d6571f-87e2-4d72-a82d-77bf28bf34c9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a" status: 404 len: 111 microversion: 2.1 time: 0.056566 Apr 14 16:21:35 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 372/1115] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:21:35 2023] GET /compute/v2.1/servers/7d0b5baa-3cec-4162-b27e-fa2665134f2a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:21:48 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-917436846", "imageRef": "e3a0daa8-78ae-44af-8756-1fad21c352f3", "flavorRef": "42", "networks": [{"uuid": "2873e414-99d7-4231-8560-2b553fe24429"}]}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:48 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:21:48 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:21:48 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] validate_networks() for [('2873e414-99d7-4231-8560-2b553fe24429', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Getting quotas for project e78327b280e74412bd43a54a522c20d0. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Getting quotas for user ffdaf3dc40b0445ea03d2f69abd46924 and project e78327b280e74412bd43a54a522c20d0. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:21:49 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3a0daa8-78ae-44af-8756-1fad21c352f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:21:49 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.734344 Apr 14 16:21:49 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 371/1116] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:21:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:21:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:21:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:21:49 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-db5fb672-ecbd-4066-9537-5e63fada792b tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:21:49 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-db5fb672-ecbd-4066-9537-5e63fada792b tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:21:49 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-db5fb672-ecbd-4066-9537-5e63fada792b tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdaf3dc40b0445ea03d2f69abd46924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78327b280e74412bd43a54a522c20d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:21:49 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-db5fb672-ecbd-4066-9537-5e63fada792b tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72" status: 200 len: 1212 microversion: 2.1 time: 0.099171 Apr 14 16:21:49 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 374/1117] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:21:49 2023] GET /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72 => generated 1212 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0643d79c-19ea-44b2-888b-537717701f72", "tag": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] Creating event network-changed:a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 for instance 0643d79c-19ea-44b2-888b-537717701f72 on user Apr 14 16:21:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041695 Apr 14 16:21:52 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 373/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:21:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-e15ee3a3-02a5-425a-ba03-6a0424a0568f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-e15ee3a3-02a5-425a-ba03-6a0424a0568f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e15ee3a3-02a5-425a-ba03-6a0424a0568f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e15ee3a3-02a5-425a-ba03-6a0424a0568f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e15ee3a3-02a5-425a-ba03-6a0424a0568f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e15ee3a3-02a5-425a-ba03-6a0424a0568f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e15ee3a3-02a5-425a-ba03-6a0424a0568f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-e15ee3a3-02a5-425a-ba03-6a0424a0568f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:52 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-e15ee3a3-02a5-425a-ba03-6a0424a0568f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-e15ee3a3-02a5-425a-ba03-6a0424a0568f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:21:52 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122 HTTP/1.1 Apr 14 16:21:52 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:21:52 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:21:52 user devstack@n-api.service[61874]: Connection: close Apr 14 16:21:52 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:21:52 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:21:52 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:21:52 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:21:52 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61874]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:21:52 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:21:52 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:21:52 user devstack@n-api.service[61874]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:21:52 user devstack@n-api.service[61874]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:21:52 user devstack@n-api.service[61874]: method: > Apr 14 16:21:52 user devstack@n-api.service[61874]: exception: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61874]: action_args: {'id': '375e1073-5299-4d9d-8100-6f626e4bf122'} Apr 14 16:21:52 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-e15ee3a3-02a5-425a-ba03-6a0424a0568f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:21:52 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-e15ee3a3-02a5-425a-ba03-6a0424a0568f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122" status: 404 len: 111 microversion: 2.1 time: 0.060812 Apr 14 16:21:52 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 372/1119] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:21:52 2023] GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-1a47a5b1-9186-4736-9ab5-231644999981 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-1a47a5b1-9186-4736-9ab5-231644999981 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1a47a5b1-9186-4736-9ab5-231644999981 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1a47a5b1-9186-4736-9ab5-231644999981 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1a47a5b1-9186-4736-9ab5-231644999981 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1a47a5b1-9186-4736-9ab5-231644999981 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1a47a5b1-9186-4736-9ab5-231644999981 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-1a47a5b1-9186-4736-9ab5-231644999981 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-1a47a5b1-9186-4736-9ab5-231644999981 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-1a47a5b1-9186-4736-9ab5-231644999981 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:21:52 user devstack@n-api.service[61876]: request: DELETE /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea HTTP/1.1 Apr 14 16:21:52 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:21:52 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:21:52 user devstack@n-api.service[61876]: Connection: close Apr 14 16:21:52 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:21:52 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:21:52 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:21:52 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:21:52 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61876]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:21:52 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:21:52 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:21:52 user devstack@n-api.service[61876]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:21:52 user devstack@n-api.service[61876]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:21:52 user devstack@n-api.service[61876]: method: > Apr 14 16:21:52 user devstack@n-api.service[61876]: exception: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:21:52 user devstack@n-api.service[61876]: action_args: {'id': '8f8afdbf-f148-4447-a480-dbbb17fc45ea'} Apr 14 16:21:52 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-1a47a5b1-9186-4736-9ab5-231644999981 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:21:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-1a47a5b1-9186-4736-9ab5-231644999981 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea" status: 404 len: 111 microversion: 2.1 time: 0.029494 Apr 14 16:21:52 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 375/1120] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:21:52 2023] DELETE /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3eb36c77-b10b-4213-ada6-c5e9478745de tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-3eb36c77-b10b-4213-ada6-c5e9478745de tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3eb36c77-b10b-4213-ada6-c5e9478745de tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3eb36c77-b10b-4213-ada6-c5e9478745de tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3eb36c77-b10b-4213-ada6-c5e9478745de tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3eb36c77-b10b-4213-ada6-c5e9478745de tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3eb36c77-b10b-4213-ada6-c5e9478745de tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-3eb36c77-b10b-4213-ada6-c5e9478745de tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-3eb36c77-b10b-4213-ada6-c5e9478745de tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3eb36c77-b10b-4213-ada6-c5e9478745de tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:21:52 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea HTTP/1.1 Apr 14 16:21:52 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:21:52 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:21:52 user devstack@n-api.service[61875]: Connection: close Apr 14 16:21:52 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:21:52 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:21:52 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:21:52 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:21:52 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:21:52 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61875]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:21:52 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:21:52 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:21:52 user devstack@n-api.service[61875]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:21:52 user devstack@n-api.service[61875]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:21:52 user devstack@n-api.service[61875]: method: > Apr 14 16:21:52 user devstack@n-api.service[61875]: exception: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:21:52 user devstack@n-api.service[61875]: action_args: {'id': '8f8afdbf-f148-4447-a480-dbbb17fc45ea'} Apr 14 16:21:52 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. Apr 14 16:21:52 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3eb36c77-b10b-4213-ada6-c5e9478745de tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:21:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-3eb36c77-b10b-4213-ada6-c5e9478745de tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea" status: 404 len: 111 microversion: 2.1 time: 0.043175 Apr 14 16:21:52 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 374/1121] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:21:52 2023] GET /compute/v2.1/servers/8f8afdbf-f148-4447-a480-dbbb17fc45ea => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-615c9faa-f567-4045-a0bf-28d9c2fa9082 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-615c9faa-f567-4045-a0bf-28d9c2fa9082 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-615c9faa-f567-4045-a0bf-28d9c2fa9082 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-615c9faa-f567-4045-a0bf-28d9c2fa9082 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-615c9faa-f567-4045-a0bf-28d9c2fa9082 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-615c9faa-f567-4045-a0bf-28d9c2fa9082 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-615c9faa-f567-4045-a0bf-28d9c2fa9082 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-615c9faa-f567-4045-a0bf-28d9c2fa9082 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:52 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-615c9faa-f567-4045-a0bf-28d9c2fa9082 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-615c9faa-f567-4045-a0bf-28d9c2fa9082 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:21:52 user devstack@n-api.service[61874]: request: DELETE /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122 HTTP/1.1 Apr 14 16:21:52 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:21:52 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:21:52 user devstack@n-api.service[61874]: Connection: close Apr 14 16:21:52 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:21:52 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:21:52 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:21:52 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:21:52 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:21:52 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61874]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:21:52 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:21:52 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:21:52 user devstack@n-api.service[61874]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:21:52 user devstack@n-api.service[61874]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:21:52 user devstack@n-api.service[61874]: method: > Apr 14 16:21:52 user devstack@n-api.service[61874]: exception: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61874]: action_args: {'id': '375e1073-5299-4d9d-8100-6f626e4bf122'} Apr 14 16:21:52 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-615c9faa-f567-4045-a0bf-28d9c2fa9082 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:21:52 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-615c9faa-f567-4045-a0bf-28d9c2fa9082 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122" status: 404 len: 111 microversion: 2.1 time: 0.030904 Apr 14 16:21:52 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 373/1122] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:21:52 2023] DELETE /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-e6ad8a52-5acf-479a-b384-5c4f2568bde0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-e6ad8a52-5acf-479a-b384-5c4f2568bde0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e6ad8a52-5acf-479a-b384-5c4f2568bde0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e6ad8a52-5acf-479a-b384-5c4f2568bde0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e6ad8a52-5acf-479a-b384-5c4f2568bde0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e6ad8a52-5acf-479a-b384-5c4f2568bde0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e6ad8a52-5acf-479a-b384-5c4f2568bde0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-e6ad8a52-5acf-479a-b384-5c4f2568bde0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-e6ad8a52-5acf-479a-b384-5c4f2568bde0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-e6ad8a52-5acf-479a-b384-5c4f2568bde0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:21:52 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122 HTTP/1.1 Apr 14 16:21:52 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:21:52 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:21:52 user devstack@n-api.service[61876]: Connection: close Apr 14 16:21:52 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:21:52 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:21:52 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:21:52 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:21:52 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:21:52 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:21:52 user devstack@n-api.service[61876]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:21:52 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:21:52 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:21:52 user devstack@n-api.service[61876]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:21:52 user devstack@n-api.service[61876]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:21:52 user devstack@n-api.service[61876]: method: > Apr 14 16:21:52 user devstack@n-api.service[61876]: exception: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61876]: action_args: {'id': '375e1073-5299-4d9d-8100-6f626e4bf122'} Apr 14 16:21:52 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. Apr 14 16:21:52 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:21:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-e6ad8a52-5acf-479a-b384-5c4f2568bde0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance 375e1073-5299-4d9d-8100-6f626e4bf122 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:21:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-e6ad8a52-5acf-479a-b384-5c4f2568bde0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122" status: 404 len: 111 microversion: 2.1 time: 0.025968 Apr 14 16:21:52 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 376/1123] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:21:52 2023] GET /compute/v2.1/servers/375e1073-5299-4d9d-8100-6f626e4bf122 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-3223f595-d33e-4cad-b300-b8cae2def7ea tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Action: 'create', calling method: .version_select at 0x7f2970ccef80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1752336842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPHd4sEqaSCGw6tAJCgB0daa6LORU2PmplYbEswYbOkD/hLJ+DdXkb5s9bzAlQ/Murb7CDKt1l6B0g+rfmWtaTX4oQZoaWyQ+hsivQlhsU9H+GSkrtj9TRMTDneLaaz4g=="}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-3223f595-d33e-4cad-b300-b8cae2def7ea tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:21:52 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-3223f595-d33e-4cad-b300-b8cae2def7ea tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for user bb3b7ae19e044c3e90292751dd633279 and project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'key_pairs'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:21:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-3223f595-d33e-4cad-b300-b8cae2def7ea tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.051697 Apr 14 16:21:52 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 375/1124] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 16:21:52 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:21:54 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-81bde587-cc93-4432-a8c8-cdac738e2f05 req-45c7dc61-af85-49e7-9225-578422bc3332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0643d79c-19ea-44b2-888b-537717701f72", "name": "network-vif-plugged", "status": "completed", "tag": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-81bde587-cc93-4432-a8c8-cdac738e2f05 req-45c7dc61-af85-49e7-9225-578422bc3332 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-81bde587-cc93-4432-a8c8-cdac738e2f05 req-45c7dc61-af85-49e7-9225-578422bc3332 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-81bde587-cc93-4432-a8c8-cdac738e2f05 req-45c7dc61-af85-49e7-9225-578422bc3332 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-81bde587-cc93-4432-a8c8-cdac738e2f05 req-45c7dc61-af85-49e7-9225-578422bc3332 service nova] Creating event network-vif-plugged:a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 for instance 0643d79c-19ea-44b2-888b-537717701f72 on user Apr 14 16:21:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-81bde587-cc93-4432-a8c8-cdac738e2f05 req-45c7dc61-af85-49e7-9225-578422bc3332 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049855 Apr 14 16:21:54 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 374/1125] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:21:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:21:56 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-97d89d18-d208-4bf4-bff1-556bb85be90a req-19a711d4-f877-46a4-98f6-0251c233bef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0643d79c-19ea-44b2-888b-537717701f72", "name": "network-vif-plugged", "status": "completed", "tag": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-97d89d18-d208-4bf4-bff1-556bb85be90a req-19a711d4-f877-46a4-98f6-0251c233bef1 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-97d89d18-d208-4bf4-bff1-556bb85be90a req-19a711d4-f877-46a4-98f6-0251c233bef1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:56 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-97d89d18-d208-4bf4-bff1-556bb85be90a req-19a711d4-f877-46a4-98f6-0251c233bef1 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:56 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-97d89d18-d208-4bf4-bff1-556bb85be90a req-19a711d4-f877-46a4-98f6-0251c233bef1 service nova] Creating event network-vif-plugged:a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 for instance 0643d79c-19ea-44b2-888b-537717701f72 on user Apr 14 16:21:56 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-97d89d18-d208-4bf4-bff1-556bb85be90a req-19a711d4-f877-46a4-98f6-0251c233bef1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029176 Apr 14 16:21:56 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 377/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:21:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-539389530", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1752336842", "security_groups": [{"name": "tempest-secgroup-smoke-510802577"}], "block_device_mapping_v2": [{"uuid": "14e6cb90-ca04-4130-8635-ab2c3243bd5e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43ce94ae-5ff4-4006-b800-67d1f29a9898"}]}} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG nova.network.neutron [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] validate_networks() for [('43ce94ae-5ff4-4006-b800-67d1f29a9898', None, None, None, None, None)] {{(pid=61875) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image limits 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image pref 0:0:0 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG nova.quota [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for user bb3b7ae19e044c3e90292751dd633279 and project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Going to run 1 instances... {{(pid=61875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:21:58 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14e6cb90-ca04-4130-8635-ab2c3243bd5e',volume_size=None,volume_type=None)] {{(pid=61875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:21:59 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.981638 Apr 14 16:21:59 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 376/1127] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:21:58 2023] POST /compute/v2.1/servers => generated 403 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:21:59 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-6d09e471-30b7-48e0-a962-2ddab7ff8e5c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:21:59 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-6d09e471-30b7-48e0-a962-2ddab7ff8e5c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:21:59 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-6d09e471-30b7-48e0-a962-2ddab7ff8e5c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:21:59 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-6d09e471-30b7-48e0-a962-2ddab7ff8e5c tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3" status: 200 len: 1089 microversion: 2.1 time: 0.082835 Apr 14 16:21:59 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 375/1128] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:21:59 2023] GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3 => generated 1089 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:01 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:22:01 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a0fd5f-afbb-42ca-be41-0d18535241b3", "tag": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:22:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:22:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:22:01 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:22:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] Creating event network-changed:2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 on user Apr 14 16:22:01 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036260 Apr 14 16:22:01 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 378/1129] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:22:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:22:07 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-45afd7dc-21be-40e2-9666-b22ee7000061 req-5855d720-5d69-4ccf-962c-e6fb99723ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a0fd5f-afbb-42ca-be41-0d18535241b3", "name": "network-vif-plugged", "status": "completed", "tag": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:22:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-45afd7dc-21be-40e2-9666-b22ee7000061 req-5855d720-5d69-4ccf-962c-e6fb99723ae9 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:22:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-45afd7dc-21be-40e2-9666-b22ee7000061 req-5855d720-5d69-4ccf-962c-e6fb99723ae9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:22:07 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-45afd7dc-21be-40e2-9666-b22ee7000061 req-5855d720-5d69-4ccf-962c-e6fb99723ae9 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:22:07 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-45afd7dc-21be-40e2-9666-b22ee7000061 req-5855d720-5d69-4ccf-962c-e6fb99723ae9 service nova] Creating event network-vif-plugged:2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 on user Apr 14 16:22:07 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-45afd7dc-21be-40e2-9666-b22ee7000061 req-5855d720-5d69-4ccf-962c-e6fb99723ae9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203509 Apr 14 16:22:07 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 377/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:22:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:22:10 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-92b0d567-439a-4f17-9747-7e45addfe4f7 req-a7ea6ef8-77f6-4f7b-bccf-9ca6e09924ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a0fd5f-afbb-42ca-be41-0d18535241b3", "name": "network-vif-plugged", "status": "completed", "tag": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:22:10 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:22:10 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=8 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:22:10 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:22:10 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=8 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:22:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-92b0d567-439a-4f17-9747-7e45addfe4f7 req-a7ea6ef8-77f6-4f7b-bccf-9ca6e09924ce service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:22:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-92b0d567-439a-4f17-9747-7e45addfe4f7 req-a7ea6ef8-77f6-4f7b-bccf-9ca6e09924ce service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:22:10 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-92b0d567-439a-4f17-9747-7e45addfe4f7 req-a7ea6ef8-77f6-4f7b-bccf-9ca6e09924ce service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:22:10 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-92b0d567-439a-4f17-9747-7e45addfe4f7 req-a7ea6ef8-77f6-4f7b-bccf-9ca6e09924ce service nova] Creating event network-vif-plugged:2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 on user Apr 14 16:22:10 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-92b0d567-439a-4f17-9747-7e45addfe4f7 req-a7ea6ef8-77f6-4f7b-bccf-9ca6e09924ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041569 Apr 14 16:22:10 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 376/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:22:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:22:39 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-8b1ba77a-0b89-483b-adf2-59c95affcd56 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:22:39 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-8b1ba77a-0b89-483b-adf2-59c95affcd56 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:22:39 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=12 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:22:39 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:22:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8b1ba77a-0b89-483b-adf2-59c95affcd56 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:22:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8b1ba77a-0b89-483b-adf2-59c95affcd56 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:22:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8b1ba77a-0b89-483b-adf2-59c95affcd56 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:22:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8b1ba77a-0b89-483b-adf2-59c95affcd56 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:22:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8b1ba77a-0b89-483b-adf2-59c95affcd56 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:22:39 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-8b1ba77a-0b89-483b-adf2-59c95affcd56 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:22:40 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-8b1ba77a-0b89-483b-adf2-59c95affcd56 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdaf3dc40b0445ea03d2f69abd46924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78327b280e74412bd43a54a522c20d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:22:40 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-8b1ba77a-0b89-483b-adf2-59c95affcd56 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72" status: 200 len: 1494 microversion: 2.1 time: 0.238162 Apr 14 16:22:40 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 379/1132] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:22:39 2023] GET /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72 => generated 1494 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:22:49 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:22:49 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell0:SELECT=10 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:22:49 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:22:49 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=8 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:22:49 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b6c2beb8-c0a3-44f8-b32a-1a2a150f926b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:22:49 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-b6c2beb8-c0a3-44f8-b32a-1a2a150f926b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:22:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b6c2beb8-c0a3-44f8-b32a-1a2a150f926b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:22:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b6c2beb8-c0a3-44f8-b32a-1a2a150f926b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:22:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b6c2beb8-c0a3-44f8-b32a-1a2a150f926b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:22:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b6c2beb8-c0a3-44f8-b32a-1a2a150f926b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:22:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b6c2beb8-c0a3-44f8-b32a-1a2a150f926b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:22:49 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b6c2beb8-c0a3-44f8-b32a-1a2a150f926b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:22:49 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-b6c2beb8-c0a3-44f8-b32a-1a2a150f926b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:22:49 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-b6c2beb8-c0a3-44f8-b32a-1a2a150f926b tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3" status: 200 len: 1441 microversion: 2.1 time: 0.238751 Apr 14 16:22:49 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 378/1133] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:22:49 2023] GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3 => generated 1441 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:23:40 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:23:40 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:23:40 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e871d92-48ee-4567-9550-68341cafac5e", "device": "/dev/vdb"}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:23:40 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:23:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:23:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:23:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:23:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:23:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:23:40 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:23:40 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439691 Apr 14 16:23:40 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 377/1134] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 16:23:40 2023] POST /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:23:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:23:49 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:23:49 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-0898bf8f-b07d-40d9-bcef-9e4aaee9a85f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:23:49 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-0898bf8f-b07d-40d9-bcef-9e4aaee9a85f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:23:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-0898bf8f-b07d-40d9-bcef-9e4aaee9a85f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:23:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-0898bf8f-b07d-40d9-bcef-9e4aaee9a85f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:23:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-0898bf8f-b07d-40d9-bcef-9e4aaee9a85f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:23:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-0898bf8f-b07d-40d9-bcef-9e4aaee9a85f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:23:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-0898bf8f-b07d-40d9-bcef-9e4aaee9a85f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:23:49 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-0898bf8f-b07d-40d9-bcef-9e4aaee9a85f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:23:49 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-0898bf8f-b07d-40d9-bcef-9e4aaee9a85f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:23:49 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-0898bf8f-b07d-40d9-bcef-9e4aaee9a85f tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3" status: 200 len: 1441 microversion: 2.1 time: 0.378811 Apr 14 16:23:49 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 380/1135] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:23:49 2023] GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3 => generated 1441 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:23:51 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:23:51 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:23:51 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a0fd5f-afbb-42ca-be41-0d18535241b3", "tag": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:23:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:23:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:23:51 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:23:51 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] Creating event network-changed:2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 on user Apr 14 16:23:51 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089476 Apr 14 16:23:51 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 379/1136] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:23:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:23:52 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:23:52 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:23:52 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:23:52 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:23:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:23:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:23:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:23:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:23:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:23:52 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:23:52 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:23:52 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3" status: 204 len: 0 microversion: 2.1 time: 0.121436 Apr 14 16:23:52 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 378/1137] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:23:52 2023] DELETE /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:23:52 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-7c167b9a-3d0a-48d2-a856-61f639ce3e0e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:23:52 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-7c167b9a-3d0a-48d2-a856-61f639ce3e0e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:23:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c167b9a-3d0a-48d2-a856-61f639ce3e0e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:23:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c167b9a-3d0a-48d2-a856-61f639ce3e0e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:23:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c167b9a-3d0a-48d2-a856-61f639ce3e0e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:23:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c167b9a-3d0a-48d2-a856-61f639ce3e0e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:23:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c167b9a-3d0a-48d2-a856-61f639ce3e0e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:23:52 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7c167b9a-3d0a-48d2-a856-61f639ce3e0e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:23:52 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-7c167b9a-3d0a-48d2-a856-61f639ce3e0e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:23:52 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-7c167b9a-3d0a-48d2-a856-61f639ce3e0e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3" status: 200 len: 1447 microversion: 2.1 time: 0.329321 Apr 14 16:23:52 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 381/1138] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:23:52 2023] GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3 => generated 1447 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:23:52 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-2f24b7d0-40d4-461c-bb4c-35a5ab63363f req-2eb5ca37-f438-41c4-8956-9603c8ef2167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a0fd5f-afbb-42ca-be41-0d18535241b3", "name": "network-vif-unplugged", "status": "completed", "tag": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:23:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-2f24b7d0-40d4-461c-bb4c-35a5ab63363f req-2eb5ca37-f438-41c4-8956-9603c8ef2167 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:23:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-2f24b7d0-40d4-461c-bb4c-35a5ab63363f req-2eb5ca37-f438-41c4-8956-9603c8ef2167 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:23:52 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-2f24b7d0-40d4-461c-bb4c-35a5ab63363f req-2eb5ca37-f438-41c4-8956-9603c8ef2167 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:23:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-2f24b7d0-40d4-461c-bb4c-35a5ab63363f req-2eb5ca37-f438-41c4-8956-9603c8ef2167 service nova] Creating event network-vif-unplugged:2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 on user Apr 14 16:23:52 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-2f24b7d0-40d4-461c-bb4c-35a5ab63363f req-2eb5ca37-f438-41c4-8956-9603c8ef2167 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032779 Apr 14 16:23:52 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 380/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:23:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:23:54 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-bab070f1-8ba7-4168-95b0-f555cba466bb req-e1438da4-b24d-41fd-a508-592594c6cc03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a0fd5f-afbb-42ca-be41-0d18535241b3", "name": "network-vif-deleted", "tag": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:23:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-bab070f1-8ba7-4168-95b0-f555cba466bb req-e1438da4-b24d-41fd-a508-592594c6cc03 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:23:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-bab070f1-8ba7-4168-95b0-f555cba466bb req-e1438da4-b24d-41fd-a508-592594c6cc03 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:23:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-bab070f1-8ba7-4168-95b0-f555cba466bb req-e1438da4-b24d-41fd-a508-592594c6cc03 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:23:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-bab070f1-8ba7-4168-95b0-f555cba466bb req-e1438da4-b24d-41fd-a508-592594c6cc03 service nova] Creating event network-vif-deleted:2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 on user Apr 14 16:23:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-bab070f1-8ba7-4168-95b0-f555cba466bb req-e1438da4-b24d-41fd-a508-592594c6cc03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035224 Apr 14 16:23:54 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 379/1140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:23:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:23:54 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a0fd5f-afbb-42ca-be41-0d18535241b3", "name": "network-vif-plugged", "status": "completed", "tag": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24"}, {"server_uuid": "20a0fd5f-afbb-42ca-be41-0d18535241b3", "name": "network-vif-plugged", "status": "completed", "tag": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24"}, {"server_uuid": "20a0fd5f-afbb-42ca-be41-0d18535241b3", "name": "network-vif-plugged", "status": "completed", "tag": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24"}, {"server_uuid": "20a0fd5f-afbb-42ca-be41-0d18535241b3", "name": "network-vif-unplugged", "status": "completed", "tag": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24"}, {"server_uuid": "20a0fd5f-afbb-42ca-be41-0d18535241b3", "name": "network-vif-plugged", "status": "completed", "tag": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:23:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:23:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:23:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:23:54 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Creating event network-vif-plugged:2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 on user Apr 14 16:23:54 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Creating event network-vif-plugged:2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 on user Apr 14 16:23:54 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Creating event network-vif-plugged:2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 on user Apr 14 16:23:54 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Creating event network-vif-unplugged:2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 on user Apr 14 16:23:54 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Creating event network-vif-plugged:2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 on user Apr 14 16:23:54 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.037583 Apr 14 16:23:54 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 382/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:23:54 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:24:04 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:24:04 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:24:04 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:04 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:04 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:04 user devstack@n-api.service[61875]: DEBUG nova.objects.instance [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'services' on Instance uuid 0643d79c-19ea-44b2-888b-537717701f72 {{(pid=61875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 16:24:04 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72/os-volume_attachments/1e871d92-48ee-4567-9550-68341cafac5e" status: 202 len: 0 microversion: 2.1 time: 0.166918 Apr 14 16:24:04 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 381/1142] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 16:24:04 2023] DELETE /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72/os-volume_attachments/1e871d92-48ee-4567-9550-68341cafac5e => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 16:24:04 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:04 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:04 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:24:04 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:24:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:04 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:04 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:24:04 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72" status: 204 len: 0 microversion: 2.1 time: 0.157094 Apr 14 16:24:04 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 380/1143] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:24:04 2023] DELETE /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:24:04 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-46764d4c-533e-4752-9718-dfac906e4a81 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:24:04 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-46764d4c-533e-4752-9718-dfac906e4a81 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:24:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-46764d4c-533e-4752-9718-dfac906e4a81 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-46764d4c-533e-4752-9718-dfac906e4a81 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-46764d4c-533e-4752-9718-dfac906e4a81 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-46764d4c-533e-4752-9718-dfac906e4a81 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-46764d4c-533e-4752-9718-dfac906e4a81 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:04 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-46764d4c-533e-4752-9718-dfac906e4a81 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:04 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-46764d4c-533e-4752-9718-dfac906e4a81 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdaf3dc40b0445ea03d2f69abd46924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78327b280e74412bd43a54a522c20d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:24:04 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-46764d4c-533e-4752-9718-dfac906e4a81 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72" status: 200 len: 1546 microversion: 2.1 time: 0.285608 Apr 14 16:24:04 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 383/1144] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:24:04 2023] GET /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72 => generated 1546 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:24:06 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-7b0dd0bf-efcd-4983-b3d5-114aaa9015c3 req-f374ff07-a494-4831-affc-c4feeefdb9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0643d79c-19ea-44b2-888b-537717701f72", "name": "network-vif-unplugged", "status": "completed", "tag": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:24:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7b0dd0bf-efcd-4983-b3d5-114aaa9015c3 req-f374ff07-a494-4831-affc-c4feeefdb9fe service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7b0dd0bf-efcd-4983-b3d5-114aaa9015c3 req-f374ff07-a494-4831-affc-c4feeefdb9fe service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:06 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-7b0dd0bf-efcd-4983-b3d5-114aaa9015c3 req-f374ff07-a494-4831-affc-c4feeefdb9fe service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:06 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-7b0dd0bf-efcd-4983-b3d5-114aaa9015c3 req-f374ff07-a494-4831-affc-c4feeefdb9fe service nova] Creating event network-vif-unplugged:a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 for instance 0643d79c-19ea-44b2-888b-537717701f72 on user Apr 14 16:24:06 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-7b0dd0bf-efcd-4983-b3d5-114aaa9015c3 req-f374ff07-a494-4831-affc-c4feeefdb9fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029951 Apr 14 16:24:06 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 382/1145] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:24:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:24:07 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-f7c1ff3b-40a0-4a23-bbec-72e68bc3b616 req-fa619ba6-3a40-436a-909a-ac6052262a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0643d79c-19ea-44b2-888b-537717701f72", "name": "network-vif-deleted", "tag": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:24:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f7c1ff3b-40a0-4a23-bbec-72e68bc3b616 req-fa619ba6-3a40-436a-909a-ac6052262a59 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f7c1ff3b-40a0-4a23-bbec-72e68bc3b616 req-fa619ba6-3a40-436a-909a-ac6052262a59 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:07 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-f7c1ff3b-40a0-4a23-bbec-72e68bc3b616 req-fa619ba6-3a40-436a-909a-ac6052262a59 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-f7c1ff3b-40a0-4a23-bbec-72e68bc3b616 req-fa619ba6-3a40-436a-909a-ac6052262a59 service nova] Creating event network-vif-deleted:a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 for instance 0643d79c-19ea-44b2-888b-537717701f72 on user Apr 14 16:24:07 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-f7c1ff3b-40a0-4a23-bbec-72e68bc3b616 req-fa619ba6-3a40-436a-909a-ac6052262a59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032362 Apr 14 16:24:07 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 381/1146] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:24:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:24:08 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-efe36005-fd3c-488a-8cc4-a331f3d6a832 req-399422de-e5cd-4e35-81f6-505cb4947532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0643d79c-19ea-44b2-888b-537717701f72", "name": "network-vif-plugged", "status": "completed", "tag": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:24:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-efe36005-fd3c-488a-8cc4-a331f3d6a832 req-399422de-e5cd-4e35-81f6-505cb4947532 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-efe36005-fd3c-488a-8cc4-a331f3d6a832 req-399422de-e5cd-4e35-81f6-505cb4947532 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:08 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-efe36005-fd3c-488a-8cc4-a331f3d6a832 req-399422de-e5cd-4e35-81f6-505cb4947532 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-efe36005-fd3c-488a-8cc4-a331f3d6a832 req-399422de-e5cd-4e35-81f6-505cb4947532 service nova] Creating event network-vif-plugged:a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 for instance 0643d79c-19ea-44b2-888b-537717701f72 on user Apr 14 16:24:08 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-efe36005-fd3c-488a-8cc4-a331f3d6a832 req-399422de-e5cd-4e35-81f6-505cb4947532 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029217 Apr 14 16:24:08 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 384/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:24:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:24:42 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b09b61c6-9ae7-46c5-88f5-8aaefde6c4ff tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:24:42 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-b09b61c6-9ae7-46c5-88f5-8aaefde6c4ff tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:24:42 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:42 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b09b61c6-9ae7-46c5-88f5-8aaefde6c4ff tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b09b61c6-9ae7-46c5-88f5-8aaefde6c4ff tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b09b61c6-9ae7-46c5-88f5-8aaefde6c4ff tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b09b61c6-9ae7-46c5-88f5-8aaefde6c4ff tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b09b61c6-9ae7-46c5-88f5-8aaefde6c4ff tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:42 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b09b61c6-9ae7-46c5-88f5-8aaefde6c4ff tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:42 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-b09b61c6-9ae7-46c5-88f5-8aaefde6c4ff tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:24:42 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b09b61c6-9ae7-46c5-88f5-8aaefde6c4ff tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:24:42 user devstack@n-api.service[61875]: request: GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3 HTTP/1.1 Apr 14 16:24:42 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:24:42 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:24:42 user devstack@n-api.service[61875]: Connection: close Apr 14 16:24:42 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:24:42 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:24:42 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:24:42 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:24:42 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:24:42 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:24:42 user devstack@n-api.service[61875]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:24:42 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:24:42 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:24:42 user devstack@n-api.service[61875]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:24:42 user devstack@n-api.service[61875]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:24:42 user devstack@n-api.service[61875]: method: > Apr 14 16:24:42 user devstack@n-api.service[61875]: exception: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:24:42 user devstack@n-api.service[61875]: action_args: {'id': '20a0fd5f-afbb-42ca-be41-0d18535241b3'} Apr 14 16:24:42 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:24:42 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:24:42 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b09b61c6-9ae7-46c5-88f5-8aaefde6c4ff tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:24:42 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-b09b61c6-9ae7-46c5-88f5-8aaefde6c4ff tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3" status: 404 len: 111 microversion: 2.1 time: 0.040251 Apr 14 16:24:42 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 383/1148] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:24:42 2023] GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:24:42 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:42 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:42 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-296106475", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1752336842", "security_groups": [{"name": "tempest-secgroup-smoke-510802577"}], "block_device_mapping_v2": [{"uuid": "14e6cb90-ca04-4130-8635-ab2c3243bd5e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43ce94ae-5ff4-4006-b800-67d1f29a9898"}]}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:24:42 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] validate_networks() for [('43ce94ae-5ff4-4006-b800-67d1f29a9898', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for user bb3b7ae19e044c3e90292751dd633279 and project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:24:43 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14e6cb90-ca04-4130-8635-ab2c3243bd5e',volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:24:43 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.848054 Apr 14 16:24:43 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 382/1149] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:24:42 2023] POST /compute/v2.1/servers => generated 403 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:24:43 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=10 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:43 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=22 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:43 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-6f76c2a5-8cb4-4226-90a6-a160e82626ba tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:24:43 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-6f76c2a5-8cb4-4226-90a6-a160e82626ba tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:24:43 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-6f76c2a5-8cb4-4226-90a6-a160e82626ba tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:24:43 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-6f76c2a5-8cb4-4226-90a6-a160e82626ba tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58" status: 200 len: 1089 microversion: 2.1 time: 0.070065 Apr 14 16:24:43 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 385/1150] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:24:43 2023] GET /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:24:45 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2b0997-a081-43e2-874f-6ae3da3ddd58", "tag": "20d85c39-102c-4f08-9b83-e1750d492acb"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:24:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:45 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:45 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] Creating event network-changed:20d85c39-102c-4f08-9b83-e1750d492acb for instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 on user Apr 14 16:24:45 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033125 Apr 14 16:24:45 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 384/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:24:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:24:54 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:54 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:54 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:54 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:54 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-a5f910c8-b6be-4d71-b937-470197180780 req-d77bf214-2643-4f56-8783-75073e79f9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2b0997-a081-43e2-874f-6ae3da3ddd58", "name": "network-vif-plugged", "status": "completed", "tag": "20d85c39-102c-4f08-9b83-e1750d492acb"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:24:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a5f910c8-b6be-4d71-b937-470197180780 req-d77bf214-2643-4f56-8783-75073e79f9dd service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a5f910c8-b6be-4d71-b937-470197180780 req-d77bf214-2643-4f56-8783-75073e79f9dd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:54 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-a5f910c8-b6be-4d71-b937-470197180780 req-d77bf214-2643-4f56-8783-75073e79f9dd service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-a5f910c8-b6be-4d71-b937-470197180780 req-d77bf214-2643-4f56-8783-75073e79f9dd service nova] Creating event network-vif-plugged:20d85c39-102c-4f08-9b83-e1750d492acb for instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 on user Apr 14 16:24:54 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-a5f910c8-b6be-4d71-b937-470197180780 req-d77bf214-2643-4f56-8783-75073e79f9dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049450 Apr 14 16:24:54 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 383/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:24:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:24:54 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-d137a8a8-4271-4ec9-b8b4-0272843c0fd0 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:24:54 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-d137a8a8-4271-4ec9-b8b4-0272843c0fd0 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:24:54 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:54 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d137a8a8-4271-4ec9-b8b4-0272843c0fd0 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d137a8a8-4271-4ec9-b8b4-0272843c0fd0 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d137a8a8-4271-4ec9-b8b4-0272843c0fd0 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d137a8a8-4271-4ec9-b8b4-0272843c0fd0 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d137a8a8-4271-4ec9-b8b4-0272843c0fd0 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:54 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-d137a8a8-4271-4ec9-b8b4-0272843c0fd0 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:54 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-d137a8a8-4271-4ec9-b8b4-0272843c0fd0 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] HTTP exception thrown: Instance 0643d79c-19ea-44b2-888b-537717701f72 could not be found. Apr 14 16:24:54 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-d137a8a8-4271-4ec9-b8b4-0272843c0fd0 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Request method failure captured: Apr 14 16:24:54 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72 HTTP/1.1 Apr 14 16:24:54 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:24:54 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:24:54 user devstack@n-api.service[61876]: Connection: close Apr 14 16:24:54 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:24:54 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:24:54 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:24:54 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:24:54 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXzMEl0XaUu5b7_2bX977zZ_v3NLI6ajlmj5JfCh_msasGNjmGQa53spyDgbqSkYkrajaMvCwVOAXC9c-tgb4ewCCMiuZEJCPCe0NbXe0mmGWKocuwpx3mv8kLHcMuCxsUSdVyhQj3zFLQGnmsFsFIubcozsjmXl2Qxc9D0ZqV4CMH4 Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Project-Id: e78327b280e74412bd43a54a522c20d0 Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1091655053 Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e78327b280e74412bd43a54a522c20d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e78327b280e74412bd43a54a522c20d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e78327b280e74412bd43a54a522c20d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Tenant: tempest-VolumesSnapshotTestJSON-1091655053 Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Tenant-Id: e78327b280e74412bd43a54a522c20d0 Apr 14 16:24:54 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1091655053 Apr 14 16:24:54 user devstack@n-api.service[61876]: X-User: tempest-VolumesSnapshotTestJSON-1091655053-project-member Apr 14 16:24:54 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:24:54 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:24:54 user devstack@n-api.service[61876]: X-User-Id: ffdaf3dc40b0445ea03d2f69abd46924 Apr 14 16:24:54 user devstack@n-api.service[61876]: X-User-Name: tempest-VolumesSnapshotTestJSON-1091655053-project-member Apr 14 16:24:54 user devstack@n-api.service[61876]: method: > Apr 14 16:24:54 user devstack@n-api.service[61876]: exception: Instance 0643d79c-19ea-44b2-888b-537717701f72 could not be found. Apr 14 16:24:54 user devstack@n-api.service[61876]: action_args: {'id': '0643d79c-19ea-44b2-888b-537717701f72'} Apr 14 16:24:54 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0643d79c-19ea-44b2-888b-537717701f72 could not be found. Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0643d79c-19ea-44b2-888b-537717701f72 could not be found. Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0643d79c-19ea-44b2-888b-537717701f72 could not be found. Apr 14 16:24:54 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:24:54 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-d137a8a8-4271-4ec9-b8b4-0272843c0fd0 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Returning 404 to user: Instance 0643d79c-19ea-44b2-888b-537717701f72 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:24:54 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-d137a8a8-4271-4ec9-b8b4-0272843c0fd0 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72" status: 404 len: 111 microversion: 2.1 time: 0.043454 Apr 14 16:24:54 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 386/1153] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:24:54 2023] GET /compute/v2.1/servers/0643d79c-19ea-44b2-888b-537717701f72 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 16:24:56 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:56 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:24:56 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-d4a2ac1b-62c0-409d-9a56-cd76110b9ee8 req-f3336c83-b7d7-4f80-a752-3fb51a83b191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2b0997-a081-43e2-874f-6ae3da3ddd58", "name": "network-vif-plugged", "status": "completed", "tag": "20d85c39-102c-4f08-9b83-e1750d492acb"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:24:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-d4a2ac1b-62c0-409d-9a56-cd76110b9ee8 req-f3336c83-b7d7-4f80-a752-3fb51a83b191 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:24:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-d4a2ac1b-62c0-409d-9a56-cd76110b9ee8 req-f3336c83-b7d7-4f80-a752-3fb51a83b191 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:24:56 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-d4a2ac1b-62c0-409d-9a56-cd76110b9ee8 req-f3336c83-b7d7-4f80-a752-3fb51a83b191 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:24:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-d4a2ac1b-62c0-409d-9a56-cd76110b9ee8 req-f3336c83-b7d7-4f80-a752-3fb51a83b191 service nova] Creating event network-vif-plugged:20d85c39-102c-4f08-9b83-e1750d492acb for instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 on user Apr 14 16:24:56 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-d4a2ac1b-62c0-409d-9a56-cd76110b9ee8 req-f3336c83-b7d7-4f80-a752-3fb51a83b191 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036790 Apr 14 16:24:56 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 385/1154] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:24:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:25:33 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:25:33 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:25:33 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-16a174e7-ea95-4c22-b11d-8d4665f6e705 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:25:33 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-16a174e7-ea95-4c22-b11d-8d4665f6e705 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:25:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-16a174e7-ea95-4c22-b11d-8d4665f6e705 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:25:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-16a174e7-ea95-4c22-b11d-8d4665f6e705 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:25:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-16a174e7-ea95-4c22-b11d-8d4665f6e705 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:25:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-16a174e7-ea95-4c22-b11d-8d4665f6e705 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:25:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-16a174e7-ea95-4c22-b11d-8d4665f6e705 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:25:33 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-16a174e7-ea95-4c22-b11d-8d4665f6e705 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:25:33 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-16a174e7-ea95-4c22-b11d-8d4665f6e705 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:25:33 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-16a174e7-ea95-4c22-b11d-8d4665f6e705 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58" status: 200 len: 1441 microversion: 2.1 time: 0.272586 Apr 14 16:25:33 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 384/1155] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:25:33 2023] GET /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58 => generated 1441 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:26:34 user devstack@n-api.service[61876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:26:34 user devstack@n-api.service[61876]: Fri Apr 14 16:26:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58 (ip 10.0.0.210) !!! Apr 14 16:26:34 user devstack@n-api.service[61876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:26:34 user devstack@n-api.service[61876]: Fri Apr 14 16:26:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58 (ip 10.0.0.210) !!! Apr 14 16:26:34 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:26:34 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:26:34 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ca3b9566-b547-47ad-9806-f4b8b2a479f9 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:26:34 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ca3b9566-b547-47ad-9806-f4b8b2a479f9 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:26:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ca3b9566-b547-47ad-9806-f4b8b2a479f9 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:26:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ca3b9566-b547-47ad-9806-f4b8b2a479f9 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:26:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ca3b9566-b547-47ad-9806-f4b8b2a479f9 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:26:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ca3b9566-b547-47ad-9806-f4b8b2a479f9 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:26:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ca3b9566-b547-47ad-9806-f4b8b2a479f9 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:26:34 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ca3b9566-b547-47ad-9806-f4b8b2a479f9 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:26:34 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-ca3b9566-b547-47ad-9806-f4b8b2a479f9 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:26:34 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ca3b9566-b547-47ad-9806-f4b8b2a479f9 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58" status: 200 len: 1441 microversion: 2.1 time: 0.258793 Apr 14 16:26:34 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 387/1156] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:26:34 2023] GET /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58 => generated 1441 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:26:36 user devstack@n-api.service[61875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:26:36 user devstack@n-api.service[61875]: Fri Apr 14 16:26:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 16:26:36 user devstack@n-api.service[61875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:26:36 user devstack@n-api.service[61875]: Fri Apr 14 16:26:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 16:26:36 user devstack@n-api.service[61875]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6025213-c7ff-47b3-9513-7d6b747e748d] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 16:26:36 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:26:36 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:26:36 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2b0997-a081-43e2-874f-6ae3da3ddd58", "tag": "20d85c39-102c-4f08-9b83-e1750d492acb"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:26:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:26:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:26:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:26:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] Creating event network-changed:20d85c39-102c-4f08-9b83-e1750d492acb for instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 on user Apr 14 16:26:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.277234 Apr 14 16:26:36 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 386/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:26:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:26:43 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-412536963", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1752336842", "security_groups": [{"name": "tempest-secgroup-smoke-510802577"}], "block_device_mapping_v2": [{"uuid": "6dbbdd8f-8039-4897-9a0c-d7e601864dfe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43ce94ae-5ff4-4006-b800-67d1f29a9898"}]}} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:26:43 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:26:43 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:26:43 user devstack@n-api.service[61874]: DEBUG nova.network.neutron [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] validate_networks() for [('43ce94ae-5ff4-4006-b800-67d1f29a9898', None, None, None, None, None)] {{(pid=61874) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image limits 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image pref 0:0:0 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG nova.quota [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting quotas for user bb3b7ae19e044c3e90292751dd633279 and project 2ffc20a7a2f44e5cafb12334ea4230eb. Resources: {'instances', 'ram', 'cores'} {{(pid=61874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Going to run 1 instances... {{(pid=61874) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 16:26:44 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6dbbdd8f-8039-4897-9a0c-d7e601864dfe',volume_size=None,volume_type=None)] {{(pid=61874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 16:26:44 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.006270 Apr 14 16:26:44 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 385/1158] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 16:26:43 2023] POST /compute/v2.1/servers => generated 403 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 16:26:44 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-85456803-3b30-4703-85e5-b80458df6cfa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:26:44 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-85456803-3b30-4703-85e5-b80458df6cfa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:26:44 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:26:44 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=6 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:26:44 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-85456803-3b30-4703-85e5-b80458df6cfa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:26:44 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-85456803-3b30-4703-85e5-b80458df6cfa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" status: 200 len: 1089 microversion: 2.1 time: 0.072155 Apr 14 16:26:44 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 388/1159] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:26:44 2023] GET /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:26:46 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef", "tag": "83b3270a-0b9d-48d8-89a4-60b99748fc88"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:26:46 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:26:46 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:26:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:26:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:26:46 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:26:46 user devstack@n-api.service[61875]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6025213-c7ff-47b3-9513-7d6b747e748d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34710. Apr 14 16:26:46 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] Creating event network-changed:83b3270a-0b9d-48d8-89a4-60b99748fc88 for instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef on user Apr 14 16:26:46 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063184 Apr 14 16:26:46 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 387/1160] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:26:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:26:53 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-3bdc2ddd-8f80-4bf7-b179-925c4e03d68d req-5c20834c-a5e8-4ac4-99d5-0249a83944e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef", "name": "network-vif-plugged", "status": "completed", "tag": "83b3270a-0b9d-48d8-89a4-60b99748fc88"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:26:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-3bdc2ddd-8f80-4bf7-b179-925c4e03d68d req-5c20834c-a5e8-4ac4-99d5-0249a83944e7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:26:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-3bdc2ddd-8f80-4bf7-b179-925c4e03d68d req-5c20834c-a5e8-4ac4-99d5-0249a83944e7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:26:53 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-3bdc2ddd-8f80-4bf7-b179-925c4e03d68d req-5c20834c-a5e8-4ac4-99d5-0249a83944e7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:26:53 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-3bdc2ddd-8f80-4bf7-b179-925c4e03d68d req-5c20834c-a5e8-4ac4-99d5-0249a83944e7 service nova] Creating event network-vif-plugged:83b3270a-0b9d-48d8-89a4-60b99748fc88 for instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef on user Apr 14 16:26:53 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-3bdc2ddd-8f80-4bf7-b179-925c4e03d68d req-5c20834c-a5e8-4ac4-99d5-0249a83944e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041094 Apr 14 16:26:53 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 386/1161] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:26:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:26:55 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-c5ff134d-6a33-4e9e-9b87-b0ce91bd78a4 req-5791926d-ffec-46c7-a340-665b90dd89e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef", "name": "network-vif-plugged", "status": "completed", "tag": "83b3270a-0b9d-48d8-89a4-60b99748fc88"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:26:55 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:26:55 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell0:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:26:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c5ff134d-6a33-4e9e-9b87-b0ce91bd78a4 req-5791926d-ffec-46c7-a340-665b90dd89e8 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:26:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c5ff134d-6a33-4e9e-9b87-b0ce91bd78a4 req-5791926d-ffec-46c7-a340-665b90dd89e8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:26:55 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-c5ff134d-6a33-4e9e-9b87-b0ce91bd78a4 req-5791926d-ffec-46c7-a340-665b90dd89e8 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:26:55 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-c5ff134d-6a33-4e9e-9b87-b0ce91bd78a4 req-5791926d-ffec-46c7-a340-665b90dd89e8 service nova] Creating event network-vif-plugged:83b3270a-0b9d-48d8-89a4-60b99748fc88 for instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef on user Apr 14 16:26:55 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-c5ff134d-6a33-4e9e-9b87-b0ce91bd78a4 req-5791926d-ffec-46c7-a340-665b90dd89e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037019 Apr 14 16:26:55 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 389/1162] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:26:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:27:34 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:27:34 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:27:34 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-69806b93-2ec3-4616-b4cd-df5328c914b3 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:27:34 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-69806b93-2ec3-4616-b4cd-df5328c914b3 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:27:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-69806b93-2ec3-4616-b4cd-df5328c914b3 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:27:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-69806b93-2ec3-4616-b4cd-df5328c914b3 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:27:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-69806b93-2ec3-4616-b4cd-df5328c914b3 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:27:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-69806b93-2ec3-4616-b4cd-df5328c914b3 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:27:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-69806b93-2ec3-4616-b4cd-df5328c914b3 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:27:34 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-69806b93-2ec3-4616-b4cd-df5328c914b3 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:27:35 user devstack@n-api.service[61875]: DEBUG nova.policy [None req-69806b93-2ec3-4616-b4cd-df5328c914b3 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61875) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:27:35 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-69806b93-2ec3-4616-b4cd-df5328c914b3 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" status: 200 len: 1441 microversion: 2.1 time: 0.464978 Apr 14 16:27:35 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 388/1163] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:27:34 2023] GET /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef => generated 1441 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:28:35 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=2 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:28:35 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell0:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:28:35 user devstack@n-api.service[61874]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:28:35 user devstack@n-api.service[61874]: Fri Apr 14 16:28:35 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef (ip 10.0.0.210) !!! Apr 14 16:28:35 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:28:35 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=4 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:28:35 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-9182567a-7bb4-4578-a68d-f69b29bea2c5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:28:35 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-9182567a-7bb4-4578-a68d-f69b29bea2c5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:28:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9182567a-7bb4-4578-a68d-f69b29bea2c5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:28:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9182567a-7bb4-4578-a68d-f69b29bea2c5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:28:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9182567a-7bb4-4578-a68d-f69b29bea2c5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:28:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9182567a-7bb4-4578-a68d-f69b29bea2c5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:28:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9182567a-7bb4-4578-a68d-f69b29bea2c5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:28:35 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-9182567a-7bb4-4578-a68d-f69b29bea2c5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:28:35 user devstack@n-api.service[61874]: DEBUG nova.policy [None req-9182567a-7bb4-4578-a68d-f69b29bea2c5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61874) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:28:35 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-9182567a-7bb4-4578-a68d-f69b29bea2c5 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" status: 200 len: 1441 microversion: 2.1 time: 0.350688 Apr 14 16:28:35 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 387/1164] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:28:35 2023] GET /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef => generated 1441 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:28:37 user devstack@n-api.service[61876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [48d92cd4-024b-465a-9141-e6d27f6562c4] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 16:28:37 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:28:37 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=2 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:28:37 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef", "tag": "83b3270a-0b9d-48d8-89a4-60b99748fc88"}]} {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:28:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:28:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:28:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:28:37 user devstack@n-api.service[61876]: INFO nova.api.openstack.compute.server_external_events [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] Creating event network-changed:83b3270a-0b9d-48d8-89a4-60b99748fc88 for instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef on user Apr 14 16:28:37 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161990 Apr 14 16:28:37 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 390/1165] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:28:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:28:38 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:28:38 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef", "tag": "83b3270a-0b9d-48d8-89a4-60b99748fc88"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:28:38 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:28:38 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=2 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:28:38 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=6 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:28:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:28:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:28:38 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:28:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:28:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:28:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:28:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:28:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:28:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:28:38 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] Creating event network-changed:83b3270a-0b9d-48d8-89a4-60b99748fc88 for instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef on user Apr 14 16:28:38 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029455 Apr 14 16:28:38 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 388/1166] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:28:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:28:38 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Going to try to terminate instance {{(pid=61875) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:28:38 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" status: 204 len: 0 microversion: 2.1 time: 0.157334 Apr 14 16:28:38 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 389/1167] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:28:38 2023] DELETE /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:28:38 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-836ac6a3-cac7-4cfe-bec3-a8c771de88d4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:28:38 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-836ac6a3-cac7-4cfe-bec3-a8c771de88d4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:28:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-836ac6a3-cac7-4cfe-bec3-a8c771de88d4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:28:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-836ac6a3-cac7-4cfe-bec3-a8c771de88d4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:28:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-836ac6a3-cac7-4cfe-bec3-a8c771de88d4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:28:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-836ac6a3-cac7-4cfe-bec3-a8c771de88d4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:28:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-836ac6a3-cac7-4cfe-bec3-a8c771de88d4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:28:38 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-836ac6a3-cac7-4cfe-bec3-a8c771de88d4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:28:38 user devstack@n-api.service[61876]: INFO oslo.messaging._drivers.impl_rabbit [-] [48d92cd4-024b-465a-9141-e6d27f6562c4] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 53974. Apr 14 16:28:39 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-836ac6a3-cac7-4cfe-bec3-a8c771de88d4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:28:39 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-836ac6a3-cac7-4cfe-bec3-a8c771de88d4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" status: 200 len: 1565 microversion: 2.1 time: 0.341081 Apr 14 16:28:39 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 391/1168] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:28:38 2023] GET /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef => generated 1565 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:28:39 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef", "name": "network-vif-unplugged", "status": "completed", "tag": "83b3270a-0b9d-48d8-89a4-60b99748fc88"}, {"server_uuid": "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef", "name": "network-vif-plugged", "status": "completed", "tag": "83b3270a-0b9d-48d8-89a4-60b99748fc88"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:28:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:28:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:28:39 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:28:39 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] Creating event network-vif-unplugged:83b3270a-0b9d-48d8-89a4-60b99748fc88 for instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef on user Apr 14 16:28:39 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] Creating event network-vif-plugged:83b3270a-0b9d-48d8-89a4-60b99748fc88 for instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef on user Apr 14 16:28:39 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032058 Apr 14 16:28:39 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 389/1169] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:28:39 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:28:40 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-ba174ddb-37b8-4b99-a438-ad159c152cd2 req-1da86925-1fde-49f4-a66e-0fa853a14ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef", "name": "network-vif-deleted", "tag": "83b3270a-0b9d-48d8-89a4-60b99748fc88"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:28:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ba174ddb-37b8-4b99-a438-ad159c152cd2 req-1da86925-1fde-49f4-a66e-0fa853a14ff7 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:28:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ba174ddb-37b8-4b99-a438-ad159c152cd2 req-1da86925-1fde-49f4-a66e-0fa853a14ff7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:28:40 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-ba174ddb-37b8-4b99-a438-ad159c152cd2 req-1da86925-1fde-49f4-a66e-0fa853a14ff7 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:28:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-ba174ddb-37b8-4b99-a438-ad159c152cd2 req-1da86925-1fde-49f4-a66e-0fa853a14ff7 service nova] Creating event network-vif-deleted:83b3270a-0b9d-48d8-89a4-60b99748fc88 for instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef on user Apr 14 16:28:40 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-ba174ddb-37b8-4b99-a438-ad159c152cd2 req-1da86925-1fde-49f4-a66e-0fa853a14ff7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031262 Apr 14 16:28:40 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 390/1170] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:28:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:29:29 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:29:29 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:29:29 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-7a614999-d1d3-4714-b830-eeb88728d43a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:29:29 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-7a614999-d1d3-4714-b830-eeb88728d43a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:29:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a614999-d1d3-4714-b830-eeb88728d43a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:29:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a614999-d1d3-4714-b830-eeb88728d43a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:29:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a614999-d1d3-4714-b830-eeb88728d43a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:29:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a614999-d1d3-4714-b830-eeb88728d43a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:29:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a614999-d1d3-4714-b830-eeb88728d43a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:29:29 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-7a614999-d1d3-4714-b830-eeb88728d43a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:29:29 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-7a614999-d1d3-4714-b830-eeb88728d43a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef could not be found. Apr 14 16:29:29 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-7a614999-d1d3-4714-b830-eeb88728d43a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:29:29 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef HTTP/1.1 Apr 14 16:29:29 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:29:29 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:29:29 user devstack@n-api.service[61876]: Connection: close Apr 14 16:29:29 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:29:29 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:29:29 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:29:29 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:29:29 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:29:29 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:29:29 user devstack@n-api.service[61876]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:29:29 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:29:29 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:29:29 user devstack@n-api.service[61876]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:29:29 user devstack@n-api.service[61876]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:29:29 user devstack@n-api.service[61876]: method: > Apr 14 16:29:29 user devstack@n-api.service[61876]: exception: Instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef could not be found. Apr 14 16:29:29 user devstack@n-api.service[61876]: action_args: {'id': '57bc1733-8a0c-49cc-85aa-e14b56cdc2ef'} Apr 14 16:29:29 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef could not be found. Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef could not be found. Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef could not be found. Apr 14 16:29:29 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:29:29 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-7a614999-d1d3-4714-b830-eeb88728d43a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:29:29 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-7a614999-d1d3-4714-b830-eeb88728d43a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" status: 404 len: 111 microversion: 2.1 time: 0.088727 Apr 14 16:29:29 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 392/1171] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:29:29 2023] GET /compute/v2.1/servers/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:29:36 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=6 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:29:36 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=10 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:29:36 user devstack@n-api.service[61874]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 16:29:36 user devstack@n-api.service[61874]: Fri Apr 14 16:29:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58 (ip 10.0.0.210) !!! Apr 14 16:29:36 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:29:36 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:29:36 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:29:36 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:29:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:29:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:29:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:29:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:29:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:29:36 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:29:36 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2b0997-a081-43e2-874f-6ae3da3ddd58", "tag": "20d85c39-102c-4f08-9b83-e1750d492acb"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:29:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:29:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:29:36 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:29:36 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Going to try to terminate instance {{(pid=61874) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 16:29:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] Creating event network-changed:20d85c39-102c-4f08-9b83-e1750d492acb for instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 on user Apr 14 16:29:36 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067193 Apr 14 16:29:36 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 391/1172] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:29:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:29:37 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58" status: 204 len: 0 microversion: 2.1 time: 0.169413 Apr 14 16:29:37 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 390/1173] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:29:36 2023] DELETE /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 16:29:37 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-ffbb906d-b654-41a3-b6ee-26600bac2bf4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:29:37 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-ffbb906d-b654-41a3-b6ee-26600bac2bf4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:29:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ffbb906d-b654-41a3-b6ee-26600bac2bf4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:29:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ffbb906d-b654-41a3-b6ee-26600bac2bf4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:29:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ffbb906d-b654-41a3-b6ee-26600bac2bf4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:29:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ffbb906d-b654-41a3-b6ee-26600bac2bf4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:29:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ffbb906d-b654-41a3-b6ee-26600bac2bf4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:29:37 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-ffbb906d-b654-41a3-b6ee-26600bac2bf4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:29:38 user devstack@n-api.service[61876]: DEBUG nova.policy [None req-ffbb906d-b654-41a3-b6ee-26600bac2bf4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61876) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 16:29:38 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-ffbb906d-b654-41a3-b6ee-26600bac2bf4 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58" status: 200 len: 1566 microversion: 2.1 time: 1.210861 Apr 14 16:29:38 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 393/1174] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:29:37 2023] GET /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58 => generated 1566 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:29:38 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2b0997-a081-43e2-874f-6ae3da3ddd58", "name": "network-vif-unplugged", "status": "completed", "tag": "20d85c39-102c-4f08-9b83-e1750d492acb"}, {"server_uuid": "ac2b0997-a081-43e2-874f-6ae3da3ddd58", "name": "network-vif-plugged", "status": "completed", "tag": "20d85c39-102c-4f08-9b83-e1750d492acb"}]} {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:29:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:29:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:29:38 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:29:39 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] Creating event network-vif-unplugged:20d85c39-102c-4f08-9b83-e1750d492acb for instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 on user Apr 14 16:29:39 user devstack@n-api.service[61875]: INFO nova.api.openstack.compute.server_external_events [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] Creating event network-vif-plugged:20d85c39-102c-4f08-9b83-e1750d492acb for instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 on user Apr 14 16:29:39 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030560 Apr 14 16:29:39 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 392/1175] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:29:38 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:29:41 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [req-abfb97b5-3316-4481-a98b-bcb05613a41b req-107c8eb1-9764-466b-a392-3ce3aedafba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2b0997-a081-43e2-874f-6ae3da3ddd58", "name": "network-vif-deleted", "tag": "20d85c39-102c-4f08-9b83-e1750d492acb"}]} {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:29:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-abfb97b5-3316-4481-a98b-bcb05613a41b req-107c8eb1-9764-466b-a392-3ce3aedafba3 service nova] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:29:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-abfb97b5-3316-4481-a98b-bcb05613a41b req-107c8eb1-9764-466b-a392-3ce3aedafba3 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:29:41 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [req-abfb97b5-3316-4481-a98b-bcb05613a41b req-107c8eb1-9764-466b-a392-3ce3aedafba3 service nova] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:29:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.compute.server_external_events [req-abfb97b5-3316-4481-a98b-bcb05613a41b req-107c8eb1-9764-466b-a392-3ce3aedafba3 service nova] Creating event network-vif-deleted:20d85c39-102c-4f08-9b83-e1750d492acb for instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 on user Apr 14 16:29:41 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [req-abfb97b5-3316-4481-a98b-bcb05613a41b req-107c8eb1-9764-466b-a392-3ce3aedafba3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033341 Apr 14 16:29:41 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 391/1176] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 16:29:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:30:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-02f329a3-35a2-4da8-a400-a18893c83d7e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:30:28 user devstack@n-api.service[61876]: DEBUG nova.compute.api [None req-02f329a3-35a2-4da8-a400-a18893c83d7e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Fetching instance by UUID {{(pid=61876) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:30:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_api:SELECT=4 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:30:28 user devstack@n-api.service[61876]: DEBUG dbcounter [-] [61876] Writing DB stats nova_cell1:SELECT=8 {{(pid=61876) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:30:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-02f329a3-35a2-4da8-a400-a18893c83d7e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:30:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-02f329a3-35a2-4da8-a400-a18893c83d7e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:30:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-02f329a3-35a2-4da8-a400-a18893c83d7e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:30:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-02f329a3-35a2-4da8-a400-a18893c83d7e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:30:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-02f329a3-35a2-4da8-a400-a18893c83d7e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:30:28 user devstack@n-api.service[61876]: DEBUG oslo_concurrency.lockutils [None req-02f329a3-35a2-4da8-a400-a18893c83d7e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61876) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:30:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.wsgi [None req-02f329a3-35a2-4da8-a400-a18893c83d7e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-02f329a3-35a2-4da8-a400-a18893c83d7e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:30:28 user devstack@n-api.service[61876]: request: GET /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58 HTTP/1.1 Apr 14 16:30:28 user devstack@n-api.service[61876]: Accept: application/json Apr 14 16:30:28 user devstack@n-api.service[61876]: Accept-Encoding: identity Apr 14 16:30:28 user devstack@n-api.service[61876]: Connection: close Apr 14 16:30:28 user devstack@n-api.service[61876]: Content-Length: 0 Apr 14 16:30:28 user devstack@n-api.service[61876]: Content-Type: application/json Apr 14 16:30:28 user devstack@n-api.service[61876]: Host: 10.0.0.210 Apr 14 16:30:28 user devstack@n-api.service[61876]: Openstack-System-Scope: None Apr 14 16:30:28 user devstack@n-api.service[61876]: User-Agent: python-urllib3/1.26.15 Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Domain-Id: None Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Domain-Name: None Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Identity-Status: Confirmed Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Is-Admin-Project: True Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Project-Domain-Id: default Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Project-Domain-Name: Default Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Role: reader,member Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Roles: reader,member Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:30:28 user devstack@n-api.service[61876]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:30:28 user devstack@n-api.service[61876]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:30:28 user devstack@n-api.service[61876]: X-User-Domain-Id: default Apr 14 16:30:28 user devstack@n-api.service[61876]: X-User-Domain-Name: Default Apr 14 16:30:28 user devstack@n-api.service[61876]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:30:28 user devstack@n-api.service[61876]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:30:28 user devstack@n-api.service[61876]: method: > Apr 14 16:30:28 user devstack@n-api.service[61876]: exception: Instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61876]: action_args: {'id': 'ac2b0997-a081-43e2-874f-6ae3da3ddd58'} Apr 14 16:30:28 user devstack@n-api.service[61876]: {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61876]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-02f329a3-35a2-4da8-a400-a18893c83d7e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 could not be found. {{(pid=61876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:30:28 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-02f329a3-35a2-4da8-a400-a18893c83d7e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58" status: 404 len: 111 microversion: 2.1 time: 0.039834 Apr 14 16:30:28 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 394/1177] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:30:28 2023] GET /compute/v2.1/servers/ac2b0997-a081-43e2-874f-6ae3da3ddd58 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:30:28 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_api:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:30:28 user devstack@n-api.service[61875]: DEBUG dbcounter [-] [61875] Writing DB stats nova_cell1:SELECT=4 {{(pid=61875) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:30:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b95b1bcb-eb2a-4652-ab8e-ed969b28c445 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:30:28 user devstack@n-api.service[61875]: DEBUG nova.compute.api [None req-b95b1bcb-eb2a-4652-ab8e-ed969b28c445 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Fetching instance by UUID {{(pid=61875) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:30:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b95b1bcb-eb2a-4652-ab8e-ed969b28c445 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:30:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b95b1bcb-eb2a-4652-ab8e-ed969b28c445 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:30:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b95b1bcb-eb2a-4652-ab8e-ed969b28c445 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:30:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b95b1bcb-eb2a-4652-ab8e-ed969b28c445 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:30:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b95b1bcb-eb2a-4652-ab8e-ed969b28c445 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:30:28 user devstack@n-api.service[61875]: DEBUG oslo_concurrency.lockutils [None req-b95b1bcb-eb2a-4652-ab8e-ed969b28c445 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61875) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:30:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.wsgi [None req-b95b1bcb-eb2a-4652-ab8e-ed969b28c445 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b95b1bcb-eb2a-4652-ab8e-ed969b28c445 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:30:28 user devstack@n-api.service[61875]: request: DELETE /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3 HTTP/1.1 Apr 14 16:30:28 user devstack@n-api.service[61875]: Accept: application/json Apr 14 16:30:28 user devstack@n-api.service[61875]: Accept-Encoding: identity Apr 14 16:30:28 user devstack@n-api.service[61875]: Connection: close Apr 14 16:30:28 user devstack@n-api.service[61875]: Content-Length: 0 Apr 14 16:30:28 user devstack@n-api.service[61875]: Content-Type: application/json Apr 14 16:30:28 user devstack@n-api.service[61875]: Host: 10.0.0.210 Apr 14 16:30:28 user devstack@n-api.service[61875]: Openstack-System-Scope: None Apr 14 16:30:28 user devstack@n-api.service[61875]: User-Agent: python-urllib3/1.26.15 Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Domain-Id: None Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Domain-Name: None Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Identity-Status: Confirmed Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Is-Admin-Project: True Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Project-Domain-Id: default Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Project-Domain-Name: Default Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Role: reader,member Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Roles: reader,member Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:30:28 user devstack@n-api.service[61875]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:30:28 user devstack@n-api.service[61875]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:30:28 user devstack@n-api.service[61875]: X-User-Domain-Id: default Apr 14 16:30:28 user devstack@n-api.service[61875]: X-User-Domain-Name: Default Apr 14 16:30:28 user devstack@n-api.service[61875]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:30:28 user devstack@n-api.service[61875]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:30:28 user devstack@n-api.service[61875]: method: > Apr 14 16:30:28 user devstack@n-api.service[61875]: exception: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61875]: action_args: {'id': '20a0fd5f-afbb-42ca-be41-0d18535241b3'} Apr 14 16:30:28 user devstack@n-api.service[61875]: {{(pid=61875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61875]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61875]: DEBUG nova.api.openstack.wsgi [None req-b95b1bcb-eb2a-4652-ab8e-ed969b28c445 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. {{(pid=61875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:30:28 user devstack@n-api.service[61875]: INFO nova.api.openstack.requestlog [None req-b95b1bcb-eb2a-4652-ab8e-ed969b28c445 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3" status: 404 len: 111 microversion: 2.1 time: 0.048679 Apr 14 16:30:28 user devstack@n-api.service[61875]: [pid: 61875|app: 0|req: 393/1178] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 16:30:28 2023] DELETE /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:30:28 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:30:28 user devstack@n-api.service[61874]: DEBUG dbcounter [-] [61874] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61874) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:30:28 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-18ed9bba-5f44-48a4-aad3-abcbf7403fae tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '>' {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:30:28 user devstack@n-api.service[61874]: DEBUG nova.compute.api [None req-18ed9bba-5f44-48a4-aad3-abcbf7403fae tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Fetching instance by UUID {{(pid=61874) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 16:30:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-18ed9bba-5f44-48a4-aad3-abcbf7403fae tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:30:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-18ed9bba-5f44-48a4-aad3-abcbf7403fae tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:30:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-18ed9bba-5f44-48a4-aad3-abcbf7403fae tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:30:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-18ed9bba-5f44-48a4-aad3-abcbf7403fae tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:30:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-18ed9bba-5f44-48a4-aad3-abcbf7403fae tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:30:28 user devstack@n-api.service[61874]: DEBUG oslo_concurrency.lockutils [None req-18ed9bba-5f44-48a4-aad3-abcbf7403fae tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8cc55bcf-99b1-4c25-9d98-1bcd635e51a5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:30:28 user devstack@n-api.service[61874]: INFO nova.api.openstack.wsgi [None req-18ed9bba-5f44-48a4-aad3-abcbf7403fae tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HTTP exception thrown: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-18ed9bba-5f44-48a4-aad3-abcbf7403fae tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Request method failure captured: Apr 14 16:30:28 user devstack@n-api.service[61874]: request: GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3 HTTP/1.1 Apr 14 16:30:28 user devstack@n-api.service[61874]: Accept: application/json Apr 14 16:30:28 user devstack@n-api.service[61874]: Accept-Encoding: identity Apr 14 16:30:28 user devstack@n-api.service[61874]: Connection: close Apr 14 16:30:28 user devstack@n-api.service[61874]: Content-Length: 0 Apr 14 16:30:28 user devstack@n-api.service[61874]: Content-Type: application/json Apr 14 16:30:28 user devstack@n-api.service[61874]: Host: 10.0.0.210 Apr 14 16:30:28 user devstack@n-api.service[61874]: Openstack-System-Scope: None Apr 14 16:30:28 user devstack@n-api.service[61874]: User-Agent: python-urllib3/1.26.15 Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Auth-Token: gAAAAABkOXuYPPv3zajndFloSDneaSyeg4WHSVjsyRW9XQQdInHMrmY_uaYMnaduZ7ZyppCC3-P_GsuQGHEAitd4Q79BEkUtmK0fIUkfCfbzEZ3IDBPoHC3_LeeQdvMJYFFSRjuMpD6W4KwRbWQZyRrsoBM7fejixjSf-wYbMvulQe7tJAiLdvk Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Domain-Id: None Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Domain-Name: None Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Identity-Status: Confirmed Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Is-Admin-Project: True Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Project-Domain-Id: default Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Project-Domain-Name: Default Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Project-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Project-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Role: reader,member Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Roles: reader,member Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ffc20a7a2f44e5cafb12334ea4230eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Tenant: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Tenant-Id: 2ffc20a7a2f44e5cafb12334ea4230eb Apr 14 16:30:28 user devstack@n-api.service[61874]: X-Tenant-Name: tempest-TestVolumeBootPattern-1344751469 Apr 14 16:30:28 user devstack@n-api.service[61874]: X-User: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:30:28 user devstack@n-api.service[61874]: X-User-Domain-Id: default Apr 14 16:30:28 user devstack@n-api.service[61874]: X-User-Domain-Name: Default Apr 14 16:30:28 user devstack@n-api.service[61874]: X-User-Id: bb3b7ae19e044c3e90292751dd633279 Apr 14 16:30:28 user devstack@n-api.service[61874]: X-User-Name: tempest-TestVolumeBootPattern-1344751469-project-member Apr 14 16:30:28 user devstack@n-api.service[61874]: method: > Apr 14 16:30:28 user devstack@n-api.service[61874]: exception: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61874]: action_args: {'id': '20a0fd5f-afbb-42ca-be41-0d18535241b3'} Apr 14 16:30:28 user devstack@n-api.service[61874]: {{(pid=61874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. Apr 14 16:30:28 user devstack@n-api.service[61874]: ERROR nova.api.openstack.wsgi Apr 14 16:30:28 user devstack@n-api.service[61874]: DEBUG nova.api.openstack.wsgi [None req-18ed9bba-5f44-48a4-aad3-abcbf7403fae tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Returning 404 to user: Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 could not be found. {{(pid=61874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 16:30:28 user devstack@n-api.service[61874]: INFO nova.api.openstack.requestlog [None req-18ed9bba-5f44-48a4-aad3-abcbf7403fae tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3" status: 404 len: 111 microversion: 2.1 time: 0.042536 Apr 14 16:30:28 user devstack@n-api.service[61874]: [pid: 61874|app: 0|req: 392/1179] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 16:30:28 2023] GET /compute/v2.1/servers/20a0fd5f-afbb-42ca-be41-0d18535241b3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 16:30:32 user devstack@n-api.service[61876]: DEBUG nova.api.openstack.wsgi [None req-815d7955-fce6-4f21-8eb3-47d4e6ee45b0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Calling method '.version_select at 0x7f29709cd7e0>' {{(pid=61876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:30:32 user devstack@n-api.service[61876]: INFO nova.api.openstack.requestlog [None req-815d7955-fce6-4f21-8eb3-47d4e6ee45b0 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1752336842" status: 202 len: 0 microversion: 2.1 time: 0.026294 Apr 14 16:30:32 user devstack@n-api.service[61876]: [pid: 61876|app: 0|req: 395/1180] 10.0.0.210 () {62 vars in 1340 bytes} [Fri Apr 14 16:30:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1752336842 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)